Attachment 1981343 Details for Bug 2224249 – LatestLogs_post_call_with_MS&Rhel

LatestLogs_post_call_with_MS&Rhel

pacemaker_rhel93.log (text/plain), 301.18 KB, created by Aravind Mahadevan on 2023-08-02 18:23:56 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Aravind Mahadevan

Created: 2023-08-02 18:23:56 UTC

Size: 301.18 KB

patch

obsolete

>Aug 01 10:59:21.126 rhel93 pacemakerd          [953377] (crm_log_init) 	info: Changed active directory to /var/lib/pacemaker/cores
>Aug 01 10:59:21.126 rhel93 pacemakerd          [953377] (ipc_post_disconnect) 	info: Disconnected from launcher IPC API
>Aug 01 10:59:21.130 rhel93 pacemakerd          [953377] (get_cluster_type) 	info: Detected an active 'corosync' cluster
>Aug 01 10:59:21.130 rhel93 pacemakerd          [953377] (mcp_read_config) 	info: Reading configuration for corosync stack
>Aug 01 10:59:21.131 rhel93 pacemakerd          [953377] (main) 	notice: Starting Pacemaker 2.1.5-9.el9_2 | build=a3f44794f94 features:agent-manpages cibsecrets corosync-ge-2 default-concurrent-fencing default-resource-stickiness default-sbd-sync generated-manpages monotonic nagios ncurses remote systemd
>Aug 01 10:59:21.131 rhel93 pacemakerd          [953377] (qb_ipcs_us_publish) 	info: server name: pacemakerd
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (pcmk__ipc_is_authentic_process_active) 	info: Could not connect to cib_ro IPC: Connection refused
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (pcmk__ipc_is_authentic_process_active) 	info: Could not connect to stonith-ng IPC: Connection refused
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (pcmk__ipc_is_authentic_process_active) 	info: Could not connect to lrmd IPC: Connection refused
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (pcmk__ipc_is_authentic_process_active) 	info: Could not connect to attrd IPC: Connection refused
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (pcmk__ipc_is_authentic_process_active) 	info: Could not connect to pengine IPC: Connection refused
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (pcmk__ipc_is_authentic_process_active) 	info: Could not connect to crmd IPC: Connection refused
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (start_child) 	info: Using uid=189 and group=189 for process pacemaker-based
>Aug 01 10:59:21.139 rhel93 pacemakerd          [953377] (start_child) 	info: Forked child 953378 for process pacemaker-based
>Aug 01 10:59:21.140 rhel93 pacemakerd          [953377] (start_child) 	info: Forked child 953379 for process pacemaker-fenced
>Aug 01 10:59:21.140 rhel93 pacemakerd          [953377] (start_child) 	info: Forked child 953380 for process pacemaker-execd
>Aug 01 10:59:21.140 rhel93 pacemakerd          [953377] (start_child) 	info: Using uid=189 and group=189 for process pacemaker-attrd
>Aug 01 10:59:21.140 rhel93 pacemakerd          [953377] (start_child) 	info: Forked child 953381 for process pacemaker-attrd
>Aug 01 10:59:21.140 rhel93 pacemakerd          [953377] (start_child) 	info: Using uid=189 and group=189 for process pacemaker-schedulerd
>Aug 01 10:59:21.141 rhel93 pacemakerd          [953377] (start_child) 	info: Forked child 953382 for process pacemaker-schedulerd
>Aug 01 10:59:21.141 rhel93 pacemakerd          [953377] (start_child) 	info: Using uid=189 and group=189 for process pacemaker-controld
>Aug 01 10:59:21.141 rhel93 pacemakerd          [953377] (start_child) 	info: Forked child 953383 for process pacemaker-controld
>Aug 01 10:59:21.141 rhel93 pacemakerd          [953377] (main) 	notice: Pacemaker daemon successfully started and accepting connections
>Aug 01 10:59:21.144 rhel93 pacemaker-execd     [953380] (crm_log_init) 	info: Changed active directory to /var/lib/pacemaker/cores
>Aug 01 10:59:21.144 rhel93 pacemaker-execd     [953380] (main) 	notice: Starting Pacemaker local executor
>Aug 01 10:59:21.144 rhel93 pacemaker-execd     [953380] (qb_ipcs_us_publish) 	info: server name: lrmd
>Aug 01 10:59:21.144 rhel93 pacemaker-execd     [953380] (main) 	notice: Pacemaker local executor successfully started and accepting connections
>Aug 01 10:59:21.144 rhel93 pacemaker-execd     [953380] (main) 	notice: OCF resource agent search path is /usr/lib/ocf/resource.d
>Aug 01 10:59:21.144 rhel93 pacemaker-fenced    [953379] (crm_log_init) 	info: Changed active directory to /var/lib/pacemaker/cores
>Aug 01 10:59:21.145 rhel93 pacemaker-fenced    [953379] (main) 	notice: Starting Pacemaker fencer
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (crm_log_init) 	info: Changed active directory to /var/lib/pacemaker/cores
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (main) 	notice: Starting Pacemaker CIB manager
>Aug 01 10:59:21.145 rhel93 pacemaker-fenced    [953379] (get_cluster_type) 	info: Verifying cluster type: 'corosync'
>Aug 01 10:59:21.145 rhel93 pacemaker-fenced    [953379] (get_cluster_type) 	info: Assuming an active 'corosync' cluster
>Aug 01 10:59:21.145 rhel93 pacemaker-fenced    [953379] (crm_cluster_connect) 	notice: Connecting to corosync cluster infrastructure
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (get_cluster_type) 	info: Verifying cluster type: 'corosync'
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (get_cluster_type) 	info: Assuming an active 'corosync' cluster
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (pcmk__daemon_can_write) 	notice: /var/lib/pacemaker/cib/cib.xml not found: No such file or directory
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (pcmk__daemon_can_write) 	notice: /var/lib/pacemaker/cib/cib.xml.sig not found: No such file or directory
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (retrieveCib) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.xml (digest: /var/lib/pacemaker/cib/cib.xml.sig)
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (cib_file_read_and_verify) 	warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2)
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (readCibXmlFile) 	warning: Primary configuration corrupt or unusable, trying backups in /var/lib/pacemaker/cib
>Aug 01 10:59:21.145 rhel93 pacemaker-based     [953378] (readCibXmlFile) 	warning: Continuing with an empty configuration.
>Aug 01 10:59:21.145 rhel93 pacemaker-schedulerd[953382] (crm_log_init) 	info: Changed active directory to /var/lib/pacemaker/cores
>Aug 01 10:59:21.145 rhel93 pacemaker-schedulerd[953382] (main) 	notice: Starting Pacemaker scheduler
>Aug 01 10:59:21.145 rhel93 pacemaker-schedulerd[953382] (qb_ipcs_us_publish) 	info: server name: pengine
>Aug 01 10:59:21.145 rhel93 pacemaker-schedulerd[953382] (main) 	notice: Pacemaker scheduler successfully started and accepting connections
>Aug 01 10:59:21.146 rhel93 pacemaker-controld  [953383] (crm_log_init) 	info: Changed active directory to /var/lib/pacemaker/cores
>Aug 01 10:59:21.146 rhel93 pacemaker-attrd     [953381] (crm_log_init) 	info: Changed active directory to /var/lib/pacemaker/cores
>Aug 01 10:59:21.146 rhel93 pacemaker-controld  [953383] (main) 	notice: Starting Pacemaker controller
>Aug 01 10:59:21.146 rhel93 pacemaker-attrd     [953381] (main) 	notice: Starting Pacemaker node attribute manager
>Aug 01 10:59:21.146 rhel93 pacemaker-attrd     [953381] (ipc_post_disconnect) 	info: Disconnected from attribute manager IPC API
>Aug 01 10:59:21.146 rhel93 pacemaker-attrd     [953381] (cib_native_signon_raw) 	info: Could not connect to CIB manager for attrd
>Aug 01 10:59:21.146 rhel93 pacemaker-attrd     [953381] (cib_native_signon_raw) 	info: Connection to CIB manager for attrd failed: Transport endpoint is not connected
>Aug 01 10:59:21.146 rhel93 pacemaker-controld  [953383] (do_log) 	info: Input I_STARTUP received in state S_STARTING from crmd_init
>Aug 01 10:59:21.146 rhel93 pacemaker-controld  [953383] (cib_native_signon_raw) 	info: Could not connect to CIB manager for crmd
>Aug 01 10:59:21.146 rhel93 pacemaker-controld  [953383] (cib_native_signon_raw) 	info: Connection to CIB manager for crmd failed: Transport endpoint is not connected
>Aug 01 10:59:21.148 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Created entry b02adc51-15d6-4b9f-ad04-25cb36672703/0x55c96d614ee0 for node rhel93/3 (1 total)
>Aug 01 10:59:21.148 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Node 3 is now known as rhel93
>Aug 01 10:59:21.152 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Node 3 has uuid 3
>Aug 01 10:59:21.152 rhel93 pacemaker-fenced    [953379] (crm_update_peer_proc) 	info: cluster_connect_cpg: Node rhel93[3] - corosync-cpg is now online
>Aug 01 10:59:21.152 rhel93 pacemaker-fenced    [953379] (update_peer_state_iter) 	notice: Node rhel93 state is now member | nodeid=3 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:21.152 rhel93 pacemaker-fenced    [953379] (pcmk__corosync_connect) 	info: Connection to corosync established
>Aug 01 10:59:21.153 rhel93 pacemaker-based     [953378] (crm_cluster_connect) 	notice: Connecting to corosync cluster infrastructure
>Aug 01 10:59:21.157 rhel93 pacemaker-fenced    [953379] (cib_native_signon_raw) 	info: Could not connect to CIB manager for stonithd
>Aug 01 10:59:21.157 rhel93 pacemaker-fenced    [953379] (cib_native_signon_raw) 	info: Connection to CIB manager for stonithd failed: Transport endpoint is not connected
>Aug 01 10:59:21.157 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Created entry 1d0ae0ac-bce7-4607-ace6-bc255957cc75/0x56133fe1eeb0 for node rhel93/3 (1 total)
>Aug 01 10:59:21.158 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Node 3 is now known as rhel93
>Aug 01 10:59:21.159 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Node 3 has uuid 3
>Aug 01 10:59:21.159 rhel93 pacemaker-based     [953378] (crm_update_peer_proc) 	info: cluster_connect_cpg: Node rhel93[3] - corosync-cpg is now online
>Aug 01 10:59:21.159 rhel93 pacemaker-based     [953378] (update_peer_state_iter) 	notice: Node rhel93 state is now member | nodeid=3 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:21.159 rhel93 pacemaker-based     [953378] (pcmk__corosync_connect) 	info: Connection to corosync established
>Aug 01 10:59:21.161 rhel93 pacemaker-based     [953378] (qb_ipcs_us_publish) 	info: server name: cib_ro
>Aug 01 10:59:21.161 rhel93 pacemaker-based     [953378] (qb_ipcs_us_publish) 	info: server name: cib_rw
>Aug 01 10:59:21.161 rhel93 pacemaker-based     [953378] (qb_ipcs_us_publish) 	info: server name: cib_shm
>Aug 01 10:59:21.161 rhel93 pacemaker-based     [953378] (main) 	notice: Pacemaker CIB manager successfully started and accepting connections
>Aug 01 10:59:21.162 rhel93 pacemaker-based     [953378] (pcmk_cpg_membership) 	info: Group cib event 0: node 3 pid 953378 joined via cpg_join
>Aug 01 10:59:21.162 rhel93 pacemaker-based     [953378] (pcmk_cpg_membership) 	info: Group cib event 0: rhel93 (node 3 pid 953378) is member
>Aug 01 10:59:21.162 rhel93 pacemaker-based     [953378] (cib_file_read_and_verify) 	warning: Could not verify cluster configuration file /var/lib/pacemaker/cib/cib.xml: No such file or directory (2)
>Aug 01 10:59:21.176 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-0.raw
>Aug 01 10:59:21.188 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.0.0 of the CIB to disk (digest: d6b33ef8090fc572254da1fc49c0b24d)
>Aug 01 10:59:21.199 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.vkZzc6 (digest: /var/lib/pacemaker/cib/cib.xu2pAd)
>Aug 01 10:59:22.148 rhel93 pacemaker-attrd     [953381] (cib_native_signon_raw) 	info: Successfully connected to CIB manager for attrd
>Aug 01 10:59:22.148 rhel93 pacemaker-attrd     [953381] (main) 	info: CIB connection active
>Aug 01 10:59:22.148 rhel93 pacemaker-controld  [953383] (cib_native_signon_raw) 	info: Successfully connected to CIB manager for crmd
>Aug 01 10:59:22.148 rhel93 pacemaker-attrd     [953381] (get_cluster_type) 	info: Verifying cluster type: 'corosync'
>Aug 01 10:59:22.148 rhel93 pacemaker-attrd     [953381] (get_cluster_type) 	info: Assuming an active 'corosync' cluster
>Aug 01 10:59:22.148 rhel93 pacemaker-attrd     [953381] (crm_cluster_connect) 	notice: Connecting to corosync cluster infrastructure
>Aug 01 10:59:22.148 rhel93 pacemaker-controld  [953383] (get_cluster_type) 	info: Verifying cluster type: 'corosync'
>Aug 01 10:59:22.148 rhel93 pacemaker-controld  [953383] (get_cluster_type) 	info: Assuming an active 'corosync' cluster
>Aug 01 10:59:22.148 rhel93 pacemaker-controld  [953383] (crm_cluster_connect) 	notice: Connecting to corosync cluster infrastructure
>Aug 01 10:59:22.154 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Created entry c61f068b-2449-4380-815b-4c390bd28df3/0x55bc59b7a150 for node rhel93/3 (1 total)
>Aug 01 10:59:22.154 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Node 3 is now known as rhel93
>Aug 01 10:59:22.155 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Created entry 493a28f8-b87f-45cb-bc61-2eb351b14637/0x561cf6296130 for node rhel93/3 (1 total)
>Aug 01 10:59:22.155 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Node 3 is now known as rhel93
>Aug 01 10:59:22.155 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Cluster node rhel93 is now in unknown state
>Aug 01 10:59:22.157 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Node 3 has uuid 3
>Aug 01 10:59:22.157 rhel93 pacemaker-attrd     [953381] (crm_update_peer_proc) 	info: cluster_connect_cpg: Node rhel93[3] - corosync-cpg is now online
>Aug 01 10:59:22.157 rhel93 pacemaker-attrd     [953381] (update_peer_state_iter) 	notice: Node rhel93 state is now member | nodeid=3 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:22.157 rhel93 pacemaker-attrd     [953381] (pcmk__corosync_connect) 	info: Connection to corosync established
>Aug 01 10:59:22.158 rhel93 pacemaker-fenced    [953379] (cib_native_signon_raw) 	info: Successfully connected to CIB manager for stonithd
>Aug 01 10:59:22.158 rhel93 pacemaker-fenced    [953379] (setup_cib) 	info: Watching for fencing topology changes
>Aug 01 10:59:22.158 rhel93 pacemaker-fenced    [953379] (qb_ipcs_us_publish) 	info: server name: stonith-ng
>Aug 01 10:59:22.159 rhel93 pacemaker-fenced    [953379] (main) 	notice: Pacemaker fencer successfully started and accepting connections
>Aug 01 10:59:22.159 rhel93 pacemaker-fenced    [953379] (pcmk_cpg_membership) 	info: Group stonith-ng event 0: node 3 pid 953379 joined via cpg_join
>Aug 01 10:59:22.159 rhel93 pacemaker-fenced    [953379] (pcmk_cpg_membership) 	info: Group stonith-ng event 0: rhel93 (node 3 pid 953379) is member
>Aug 01 10:59:22.159 rhel93 pacemaker-fenced    [953379] (init_cib_cache_cb) 	info: Updating device list from CIB
>Aug 01 10:59:22.159 rhel93 pacemaker-fenced    [953379] (cib_devices_update) 	info: Updating devices to version 0.0.0
>Aug 01 10:59:22.159 rhel93 pacemaker-fenced    [953379] (unpack_nodes) 	info: Creating a fake local node
>Aug 01 10:59:22.159 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Node 3 has uuid 3
>Aug 01 10:59:22.159 rhel93 pacemaker-controld  [953383] (crm_update_peer_proc) 	info: cluster_connect_cpg: Node rhel93[3] - corosync-cpg is now online
>Aug 01 10:59:22.161 rhel93 pacemaker-attrd     [953381] (main) 	info: Cluster connection active
>Aug 01 10:59:22.161 rhel93 pacemaker-attrd     [953381] (attrd_erase_attrs) 	info: Clearing transient attributes from CIB | xpath=//node_state[@uname='rhel93']/transient_attributes
>Aug 01 10:59:22.161 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_delete operation for section //node_state[@uname='rhel93']/transient_attributes to all (origin=local/attrd/2)
>Aug 01 10:59:22.164 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Node rhel93 is now a peer | DC=<none> old=0000000 new=0x4000000
>Aug 01 10:59:22.164 rhel93 pacemaker-controld  [953383] (te_trigger_stonith_history_sync) 	info: Fence history will be synchronized cluster-wide within 5 seconds
>Aug 01 10:59:22.164 rhel93 pacemaker-controld  [953383] (pcmk__corosync_connect) 	info: Connection to corosync established
>Aug 01 10:59:22.166 rhel93 pacemaker-attrd     [953381] (qb_ipcs_us_publish) 	info: server name: attrd
>Aug 01 10:59:22.166 rhel93 pacemaker-attrd     [953381] (main) 	notice: Pacemaker node attribute manager successfully started and accepting connections
>Aug 01 10:59:22.166 rhel93 pacemaker-attrd     [953381] (pcmk_cpg_membership) 	info: Group attrd event 0: node 3 pid 953381 joined via cpg_join
>Aug 01 10:59:22.166 rhel93 pacemaker-attrd     [953381] (pcmk_cpg_membership) 	info: Group attrd event 0: rhel93 (node 3 pid 953381) is member
>Aug 01 10:59:22.166 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting #attrd-protocol[rhel93]: (unset) -> 5 | from rhel93 with no write delay
>Aug 01 10:59:22.166 rhel93 pacemaker-attrd     [953381] (attrd_start_election_if_needed) 	info: Starting an election to determine the writer
>Aug 01 10:59:22.166 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_delete operation for section //node_state[@uname='rhel93']/transient_attributes: OK (rc=0, origin=rhel93/attrd/2, version=0.0.0)
>Aug 01 10:59:22.167 rhel93 pacemaker-attrd     [953381] (election_check) 	info: election-attrd won by local node
>Aug 01 10:59:22.167 rhel93 pacemaker-attrd     [953381] (attrd_declare_winner) 	notice: Recorded local node as attribute writer (was unset)
>Aug 01 10:59:22.167 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 1 private change for #attrd-protocol, id=n/a, set=n/a
>Aug 01 10:59:22.168 rhel93 pacemaker-controld  [953383] (pcmk__corosync_quorum_connect) 	warning: No quorum
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Created entry aab07088-f6eb-4ff0-b192-e5408cef0533/0x561cf6299b50 for node rhel91/1 (2 total)
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Node 1 is now known as rhel91
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Cluster node rhel91 is now in unknown state
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Node 1 has uuid 1
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Created entry 0084eedf-a140-4ed9-8aba-2fc5a036d099/0x561cf6299bd0 for node rhel92/2 (3 total)
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Node 2 is now known as rhel92
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Cluster node rhel92 is now in unknown state
>Aug 01 10:59:22.170 rhel93 pacemaker-controld  [953383] (crm_get_peer) 	info: Node 2 has uuid 2
>Aug 01 10:59:22.173 rhel93 pacemaker-controld  [953383] (do_ha_control) 	info: Connected to the cluster
>Aug 01 10:59:22.173 rhel93 pacemaker-controld  [953383] (lrmd_ipc_connect) 	info: Connecting to executor
>Aug 01 10:59:22.173 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section nodes to all (origin=local/crmd/5)
>Aug 01 10:59:22.174 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.0.0 2
>Aug 01 10:59:22.174 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.1.0 (null)
>Aug 01 10:59:22.174 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=1
>Aug 01 10:59:22.174 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/nodes:  <node id="1" uname="rhel91"/>
>Aug 01 10:59:22.174 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/nodes:  <node id="2" uname="rhel92"/>
>Aug 01 10:59:22.174 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/nodes:  <node id="3" uname="rhel93"/>
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (try_local_executor_connect) 	info: Connection to the local executor established
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (do_started) 	info: Delaying start, no membership data (0000000000100000)
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (do_started) 	info: Delaying start, no membership data (0000000000100000)
>Aug 01 10:59:22.174 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section nodes: OK (rc=0, origin=rhel93/crmd/5, version=0.1.0)
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (quorum_notification_cb) 	info: Quorum still lost | membership=22 members=1
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (update_peer_state_iter) 	notice: Node rhel93 state is now member | nodeid=3 previous=unknown source=quorum_notification_cb
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Cluster node rhel93 is now member (was in unknown state)
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (pcmk__reap_unseen_nodes) 	info: State of node rhel91[1] is still unknown
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (pcmk__reap_unseen_nodes) 	info: State of node rhel92[2] is still unknown
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (qb_ipcs_us_publish) 	info: server name: crmd
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (do_started) 	notice: Pacemaker controller successfully started and accepting connections
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (do_log) 	info: Input I_PENDING received in state S_STARTING from do_started
>Aug 01 10:59:22.174 rhel93 pacemaker-controld  [953383] (do_state_transition) 	notice: State transition S_STARTING -> S_PENDING | input=I_PENDING cause=C_FSA_INTERNAL origin=do_started
>Aug 01 10:59:22.188 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-1.raw
>Aug 01 10:59:22.202 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.1.0 of the CIB to disk (digest: 87d535c96887c6e8ede61cb7a17de1a3)
>Aug 01 10:59:22.217 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.4PoJby (digest: /var/lib/pacemaker/cib/cib.hwBsd2)
>Aug 01 10:59:23.175 rhel93 pacemaker-controld  [953383] (pcmk_cpg_membership) 	info: Group crmd event 0: node 3 pid 953383 joined via cpg_join
>Aug 01 10:59:23.175 rhel93 pacemaker-controld  [953383] (pcmk_cpg_membership) 	info: Group crmd event 0: rhel93 (node 3 pid 953383) is member
>Aug 01 10:59:23.176 rhel93 pacemaker-controld  [953383] (te_trigger_stonith_history_sync) 	info: Fence history will be synchronized cluster-wide within 30 seconds
>Aug 01 10:59:23.176 rhel93 pacemaker-controld  [953383] (te_connect_stonith) 	notice: Fencer successfully connected
>Aug 01 10:59:23.356 rhel93 pacemaker-attrd     [953381] (pcmk_cpg_membership) 	info: Group attrd event 1: node 2 pid 1478936 joined via cluster join
>Aug 01 10:59:23.356 rhel93 pacemaker-attrd     [953381] (pcmk_cpg_membership) 	info: Group attrd event 1: node 1 pid 3734571 joined via cluster join
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (pcmk_cpg_membership) 	info: Group crmd event 1: node 2 pid 1478938 joined via cluster join
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (pcmk_cpg_membership) 	info: Group crmd event 1: node 1 pid 3734573 joined via cluster join
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (pcmk_cpg_membership) 	info: Group crmd event 1: rhel91 (node 1 pid 3734573) is member
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel91[1] - corosync-cpg is now online
>Aug 01 10:59:23.356 rhel93 pacemaker-fenced    [953379] (pcmk_cpg_membership) 	info: Group stonith-ng event 1: node 2 pid 1478934 joined via cluster join
>Aug 01 10:59:23.356 rhel93 pacemaker-fenced    [953379] (pcmk_cpg_membership) 	info: Group stonith-ng event 1: node 1 pid 3734569 joined via cluster join
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Node rhel91 is now a peer | DC=<none> old=0000000 new=0x4000000
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (te_trigger_stonith_history_sync) 	info: Fence history will be synchronized cluster-wide within 5 seconds
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (pcmk_cpg_membership) 	info: Group crmd event 1: rhel92 (node 2 pid 1478938) is member
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel92[2] - corosync-cpg is now online
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Node rhel92 is now a peer | DC=<none> old=0000000 new=0x4000000
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (te_trigger_stonith_history_sync) 	info: Fence history will be synchronized cluster-wide within 5 seconds
>Aug 01 10:59:23.356 rhel93 pacemaker-controld  [953383] (pcmk_cpg_membership) 	info: Group crmd event 1: rhel93 (node 3 pid 953383) is member
>Aug 01 10:59:23.356 rhel93 pacemaker-based     [953378] (pcmk_cpg_membership) 	info: Group cib event 1: node 2 pid 1478933 joined via cluster join
>Aug 01 10:59:23.356 rhel93 pacemaker-based     [953378] (pcmk_cpg_membership) 	info: Group cib event 1: node 1 pid 3734568 joined via cluster join
>Aug 01 10:59:23.360 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Created entry e50dc7c6-7891-478c-a7fe-9a81b61687d9/0x55bc59b78f80 for node rhel91/1 (2 total)
>Aug 01 10:59:23.360 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Node 1 is now known as rhel91
>Aug 01 10:59:23.360 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Node 1 has uuid 1
>Aug 01 10:59:23.360 rhel93 pacemaker-attrd     [953381] (pcmk_cpg_membership) 	info: Group attrd event 1: rhel91 (node 1 pid 3734571) is member
>Aug 01 10:59:23.360 rhel93 pacemaker-attrd     [953381] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel91[1] - corosync-cpg is now online
>Aug 01 10:59:23.360 rhel93 pacemaker-attrd     [953381] (update_peer_state_iter) 	notice: Node rhel91 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:23.362 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Created entry 18dbe727-2963-4c59-8192-d0baf6843ee5/0x55c96d610e00 for node rhel91/1 (2 total)
>Aug 01 10:59:23.362 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Node 1 is now known as rhel91
>Aug 01 10:59:23.362 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Node 1 has uuid 1
>Aug 01 10:59:23.362 rhel93 pacemaker-fenced    [953379] (pcmk_cpg_membership) 	info: Group stonith-ng event 1: rhel91 (node 1 pid 3734569) is member
>Aug 01 10:59:23.362 rhel93 pacemaker-fenced    [953379] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel91[1] - corosync-cpg is now online
>Aug 01 10:59:23.362 rhel93 pacemaker-fenced    [953379] (update_peer_state_iter) 	notice: Node rhel91 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:23.362 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Created entry f3b02391-abae-4f37-9242-1541c89460f3/0x56133fe21f00 for node rhel91/1 (2 total)
>Aug 01 10:59:23.362 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Node 1 is now known as rhel91
>Aug 01 10:59:23.362 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Node 1 has uuid 1
>Aug 01 10:59:23.362 rhel93 pacemaker-based     [953378] (pcmk_cpg_membership) 	info: Group cib event 1: rhel91 (node 1 pid 3734568) is member
>Aug 01 10:59:23.362 rhel93 pacemaker-based     [953378] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel91[1] - corosync-cpg is now online
>Aug 01 10:59:23.362 rhel93 pacemaker-based     [953378] (update_peer_state_iter) 	notice: Node rhel91 state is now member | nodeid=1 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:23.365 rhel93 pacemaker-controld  [953383] (quorum_notification_cb) 	notice: Quorum acquired | membership=26 members=3
>Aug 01 10:59:23.365 rhel93 pacemaker-controld  [953383] (update_peer_state_iter) 	notice: Node rhel91 state is now member | nodeid=1 previous=unknown source=quorum_notification_cb
>Aug 01 10:59:23.365 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Cluster node rhel91 is now member (was in unknown state)
>Aug 01 10:59:23.365 rhel93 pacemaker-controld  [953383] (update_peer_state_iter) 	notice: Node rhel92 state is now member | nodeid=2 previous=unknown source=quorum_notification_cb
>Aug 01 10:59:23.365 rhel93 pacemaker-controld  [953383] (peer_update_callback) 	info: Cluster node rhel92 is now member (was in unknown state)
>Aug 01 10:59:23.365 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Created entry 5cf26ce7-ce1a-46f2-af16-2fe032cf6544/0x55bc59b80440 for node rhel92/2 (3 total)
>Aug 01 10:59:23.365 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Node 2 is now known as rhel92
>Aug 01 10:59:23.365 rhel93 pacemaker-attrd     [953381] (crm_get_peer) 	info: Node 2 has uuid 2
>Aug 01 10:59:23.365 rhel93 pacemaker-attrd     [953381] (pcmk_cpg_membership) 	info: Group attrd event 1: rhel92 (node 2 pid 1478936) is member
>Aug 01 10:59:23.365 rhel93 pacemaker-attrd     [953381] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel92[2] - corosync-cpg is now online
>Aug 01 10:59:23.366 rhel93 pacemaker-attrd     [953381] (update_peer_state_iter) 	notice: Node rhel92 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:23.366 rhel93 pacemaker-attrd     [953381] (pcmk_cpg_membership) 	info: Group attrd event 1: rhel93 (node 3 pid 953381) is member
>Aug 01 10:59:23.366 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Created entry 59282f27-280c-480f-b499-c9502194bc44/0x55c96d6054c0 for node rhel92/2 (3 total)
>Aug 01 10:59:23.366 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Node 2 is now known as rhel92
>Aug 01 10:59:23.366 rhel93 pacemaker-fenced    [953379] (crm_get_peer) 	info: Node 2 has uuid 2
>Aug 01 10:59:23.366 rhel93 pacemaker-fenced    [953379] (pcmk_cpg_membership) 	info: Group stonith-ng event 1: rhel92 (node 2 pid 1478934) is member
>Aug 01 10:59:23.366 rhel93 pacemaker-fenced    [953379] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel92[2] - corosync-cpg is now online
>Aug 01 10:59:23.366 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Created entry 788dd622-e24c-4b9e-a1df-a77f92c479c8/0x56133fe1f2e0 for node rhel92/2 (3 total)
>Aug 01 10:59:23.366 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Node 2 is now known as rhel92
>Aug 01 10:59:23.366 rhel93 pacemaker-based     [953378] (crm_get_peer) 	info: Node 2 has uuid 2
>Aug 01 10:59:23.366 rhel93 pacemaker-fenced    [953379] (update_peer_state_iter) 	notice: Node rhel92 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:23.366 rhel93 pacemaker-based     [953378] (pcmk_cpg_membership) 	info: Group cib event 1: rhel92 (node 2 pid 1478933) is member
>Aug 01 10:59:23.366 rhel93 pacemaker-based     [953378] (crm_update_peer_proc) 	info: pcmk_cpg_membership: Node rhel92[2] - corosync-cpg is now online
>Aug 01 10:59:23.366 rhel93 pacemaker-fenced    [953379] (pcmk_cpg_membership) 	info: Group stonith-ng event 1: rhel93 (node 3 pid 953379) is member
>Aug 01 10:59:23.366 rhel93 pacemaker-based     [953378] (update_peer_state_iter) 	notice: Node rhel92 state is now member | nodeid=2 previous=unknown source=crm_update_peer_proc
>Aug 01 10:59:23.366 rhel93 pacemaker-based     [953378] (pcmk_cpg_membership) 	info: Group cib event 1: rhel93 (node 3 pid 953378) is member
>Aug 01 10:59:23.572 rhel93 pacemaker-attrd     [953381] (attrd_check_for_new_writer) 	notice: Detected another attribute writer (rhel92), starting new election
>Aug 01 10:59:23.572 rhel93 pacemaker-attrd     [953381] (attrd_peer_sync_response) 	info: Processing sync-response from rhel92
>Aug 01 10:59:23.572 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting #attrd-protocol[rhel92]: (unset) -> 5 | from rhel92 with no write delay
>Aug 01 10:59:23.572 rhel93 pacemaker-attrd     [953381] (attrd_check_for_new_writer) 	notice: Recorded new attribute writer: rhel91 (was rhel93)
>Aug 01 10:59:23.572 rhel93 pacemaker-attrd     [953381] (attrd_peer_sync_response) 	info: Processing sync-response from rhel91
>Aug 01 10:59:23.572 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting #attrd-protocol[rhel91]: (unset) -> 5 | from rhel91 with no write delay
>Aug 01 10:59:23.573 rhel93 pacemaker-attrd     [953381] (election_count_vote) 	info: election-attrd round 2 (owner node ID 1) pass: vote from rhel91 (Uptime)
>Aug 01 10:59:23.573 rhel93 pacemaker-attrd     [953381] (attrd_peer_sync_response) 	info: Processing sync-response from rhel91
>Aug 01 10:59:23.573 rhel93 pacemaker-attrd     [953381] (attrd_peer_sync_response) 	info: Processing sync-response from rhel91
>Aug 01 10:59:23.573 rhel93 pacemaker-attrd     [953381] (election_count_vote) 	info: election-attrd round 2 (owner node ID 2) pass: vote from rhel92 (Uptime)
>Aug 01 10:59:23.573 rhel93 pacemaker-attrd     [953381] (attrd_peer_sync_response) 	info: Processing sync-response from rhel92
>Aug 01 10:59:23.573 rhel93 pacemaker-attrd     [953381] (election_count_vote) 	info: election-attrd round 3 (owner node ID 1) pass: vote from rhel91 (Uptime)
>Aug 01 10:59:23.574 rhel93 pacemaker-attrd     [953381] (attrd_peer_sync_response) 	info: Processing sync-response from rhel92
>Aug 01 10:59:23.575 rhel93 pacemaker-attrd     [953381] (election_check) 	info: election-attrd won by local node
>Aug 01 10:59:23.575 rhel93 pacemaker-attrd     [953381] (attrd_declare_winner) 	notice: Recorded local node as attribute writer (was unset)
>Aug 01 10:59:23.575 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for #attrd-protocol, id=n/a, set=n/a
>Aug 01 10:59:43.149 rhel93 pacemaker-controld  [953383] (election_count_vote) 	info: election-DC round 1 (owner node ID 2) lost: vote from rhel92 (Uptime)
>Aug 01 10:59:43.149 rhel93 pacemaker-controld  [953383] (do_log) 	info: Input I_PENDING received in state S_PENDING from do_election_count_vote
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section cib: OK (rc=0, origin=rhel92/crmd/9, version=0.1.0)
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.1.0 2
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.2.0 (null)
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=2
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/crm_config:  <cluster_property_set id="cib-bootstrap-options"/>
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                   <nvpair id="cib-bootstrap-options-have-watchdog" name="have-watchdog" value="false"/>
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                 </cluster_property_set>
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=rhel92/crmd/11, version=0.2.0)
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.2.0 2
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.3.0 (null)
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=3
>Aug 01 10:59:43.163 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/crm_config/cluster_property_set[@id='cib-bootstrap-options']:  <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="2.1.5-9.el9_2-a3f44794f94"/>
>Aug 01 10:59:43.164 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=rhel92/crmd/13, version=0.3.0)
>Aug 01 10:59:43.165 rhel93 pacemaker-controld  [953383] (stonith__watchdog_fencing_enabled_for_node_api) 	notice: Cluster does not have watchdog fencing device
>Aug 01 10:59:43.165 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.3.0 2
>Aug 01 10:59:43.165 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.4.0 (null)
>Aug 01 10:59:43.165 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=4
>Aug 01 10:59:43.165 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/crm_config/cluster_property_set[@id='cib-bootstrap-options']:  <nvpair id="cib-bootstrap-options-cluster-infrastructure" name="cluster-infrastructure" value="corosync"/>
>Aug 01 10:59:43.165 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=rhel92/crmd/15, version=0.4.0)
>Aug 01 10:59:43.165 rhel93 pacemaker-controld  [953383] (stonith__watchdog_fencing_enabled_for_node_api) 	notice: Cluster does not have watchdog fencing device
>Aug 01 10:59:43.166 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.4.0 2
>Aug 01 10:59:43.166 rhel93 pacemaker-controld  [953383] (update_dc) 	info: Set DC to rhel92 (3.16.2)
>Aug 01 10:59:43.166 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.0 (null)
>Aug 01 10:59:43.166 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=5
>Aug 01 10:59:43.166 rhel93 pacemaker-controld  [953383] (pcmk__update_peer_expected) 	info: update_dc: Node rhel92[2] - expected state is now member (was (null))
>Aug 01 10:59:43.166 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/crm_config/cluster_property_set[@id='cib-bootstrap-options']:  <nvpair id="cib-bootstrap-options-cluster-name" name="cluster-name" value="cluster1"/>
>Aug 01 10:59:43.166 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section crm_config: OK (rc=0, origin=rhel92/crmd/17, version=0.5.0)
>Aug 01 10:59:43.166 rhel93 pacemaker-controld  [953383] (stonith__watchdog_fencing_enabled_for_node_api) 	notice: Cluster does not have watchdog fencing device
>Aug 01 10:59:43.168 rhel93 pacemaker-based     [953378] (cib_process_replace) 	info: Digest matched on replace from rhel92: 168cc25e1ac95f5ce314e1cdd0adbf01
>Aug 01 10:59:43.168 rhel93 pacemaker-based     [953378] (cib_process_replace) 	info: Replaced 0.5.0 with 0.5.0 from rhel92
>Aug 01 10:59:43.168 rhel93 pacemaker-controld  [953383] (connect_and_send_attrd_request) 	info: Connecting to cluster... 5 retries remaining
>Aug 01 10:59:43.168 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_replace operation for section 'all': OK (rc=0, origin=rhel92/crmd/22, version=0.5.0)
>Aug 01 10:59:43.168 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section nodes: OK (rc=0, origin=rhel92/crmd/23, version=0.5.0)
>Aug 01 10:59:43.168 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section nodes: OK (rc=0, origin=rhel92/crmd/24, version=0.5.0)
>Aug 01 10:59:43.168 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section nodes: OK (rc=0, origin=rhel92/crmd/25, version=0.5.0)
>Aug 01 10:59:43.169 rhel93 pacemaker-controld  [953383] (do_log) 	info: Input I_NOT_DC received in state S_PENDING from do_cl_join_finalize_respond
>Aug 01 10:59:43.169 rhel93 pacemaker-controld  [953383] (do_state_transition) 	notice: State transition S_PENDING -> S_NOT_DC | input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond
>Aug 01 10:59:43.169 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting #feature-set[rhel92]: (unset) -> 3.16.2 | from rhel92 with no write delay
>Aug 01 10:59:43.169 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Sent CIB request 4 with 1 change for #feature-set (id n/a, set n/a)
>Aug 01 10:59:43.169 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/attrd/4)
>Aug 01 10:59:43.169 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting #feature-set[rhel93]: (unset) -> 3.16.2 | from rhel93 with no write delay
>Aug 01 10:59:43.169 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Write out of '#feature-set' delayed: update 4 in progress
>Aug 01 10:59:43.170 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting #feature-set[rhel91]: (unset) -> 3.16.2 | from rhel91 with no write delay
>Aug 01 10:59:43.170 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Write out of '#feature-set' delayed: update 4 in progress
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_delete operation for section //node_state[@uname='rhel92']/lrm: OK (rc=0, origin=rhel92/crmd/26, version=0.5.0)
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.0 2
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.1 (null)
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=1
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status:  <node_state id="2" uname="rhel92" in_ccm="true" crmd="online" crm-debug-origin="controld_query_executor_state"/>
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                 <lrm id="2">
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                   <lrm_resources/>
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                 </lrm>
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++               </node_state>
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/27, version=0.5.1)
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_delete operation for section //node_state[@uname='rhel93']/lrm: OK (rc=0, origin=rhel92/crmd/28, version=0.5.1)
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.1 2
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.2 (null)
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=2
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status:  <node_state id="3" uname="rhel93" in_ccm="true" crmd="online" crm-debug-origin="controld_query_executor_state"/>
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                 <lrm id="3">
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                   <lrm_resources/>
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                 </lrm>
>Aug 01 10:59:43.170 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++               </node_state>
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/29, version=0.5.2)
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.2 2
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.3 (null)
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=3
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='2']:  <transient_attributes id="2"/>
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                     <instance_attributes id="status-2">
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                       <nvpair id="status-2-.feature-set" name="#feature-set" value="3.16.2"/>
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                     </instance_attributes>
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                   </transient_attributes>
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/attrd/4, version=0.5.3)
>Aug 01 10:59:43.171 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: CIB update 4 result for #feature-set: OK | rc=0
>Aug 01 10:59:43.171 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * #feature-set[rhel91]=(null)
>Aug 01 10:59:43.171 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * #feature-set[rhel93]=(null)
>Aug 01 10:59:43.171 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * #feature-set[rhel92]=3.16.2
>Aug 01 10:59:43.171 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Sent CIB request 5 with 3 changes for #feature-set (id n/a, set n/a)
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/attrd/5)
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_delete operation for section //node_state[@uname='rhel91']/lrm: OK (rc=0, origin=rhel92/crmd/30, version=0.5.3)
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.3 2
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.4 (null)
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=4
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status:  <node_state id="1" uname="rhel91" in_ccm="true" crmd="online" crm-debug-origin="controld_query_executor_state"/>
>Aug 01 10:59:43.171 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                 <lrm id="1">
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                   <lrm_resources/>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                 </lrm>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++               </node_state>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/31, version=0.5.4)
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section nodes: OK (rc=0, origin=rhel92/crmd/35, version=0.5.4)
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.4 2
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.5 (null)
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=5
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='2']:  @crm-debug-origin=do_state_transition, @join=member, @expected=member
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='3']:  @crm-debug-origin=do_state_transition, @join=member, @expected=member
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']:  @crm-debug-origin=do_state_transition, @join=member, @expected=member
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/36, version=0.5.5)
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.5 2
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.6 (null)
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=6, @have-quorum=1, @dc-uuid=2
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section cib: OK (rc=0, origin=rhel92/crmd/37, version=0.5.6)
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.6 2
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.5.7 (null)
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=7
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='3']:  <transient_attributes id="3"/>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                     <instance_attributes id="status-3">
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                       <nvpair id="status-3-.feature-set" name="#feature-set" value="3.16.2"/>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                     </instance_attributes>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                   </transient_attributes>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='1']:  <transient_attributes id="1"/>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                     <instance_attributes id="status-1">
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                       <nvpair id="status-1-.feature-set" name="#feature-set" value="3.16.2"/>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                     </instance_attributes>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                   </transient_attributes>
>Aug 01 10:59:43.172 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/attrd/5, version=0.5.7)
>Aug 01 10:59:43.173 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: CIB update 5 result for #feature-set: OK | rc=0
>Aug 01 10:59:43.173 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * #feature-set[rhel91]=3.16.2
>Aug 01 10:59:43.173 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * #feature-set[rhel93]=3.16.2
>Aug 01 10:59:43.173 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * #feature-set[rhel92]=3.16.2
>Aug 01 10:59:43.181 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-2.raw
>Aug 01 10:59:43.190 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.3.0 of the CIB to disk (digest: 49e532c4f89fe3b1e2ee59b64e757f7e)
>Aug 01 10:59:43.197 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.rCqb0H (digest: /var/lib/pacemaker/cib/cib.j6xogG)
>Aug 01 10:59:43.214 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-3.raw
>Aug 01 10:59:43.223 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.5.0 of the CIB to disk (digest: 0933e218a09d4aea1d82c8e59ac79537)
>Aug 01 10:59:43.232 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.9ZG0qQ (digest: /var/lib/pacemaker/cib/cib.if5Cb2)
>Aug 01 10:59:48.174 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: 740c6722418b824887dd3d3b0cece4be for 0.5.7 (0x56133fe28e30 0)
>Aug 01 10:59:48.367 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.5.7 2
>Aug 01 10:59:48.367 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.6.0 (null)
>Aug 01 10:59:48.367 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=6, @num_updates=0
>Aug 01 10:59:48.367 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/crm_config/cluster_property_set[@id='cib-bootstrap-options']:  <nvpair id="cib-bootstrap-options-stonith-enabled" name="stonith-enabled" value="false"/>
>Aug 01 10:59:48.367 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=rhel91/cibadmin/2, version=0.6.0)
>Aug 01 10:59:48.368 rhel93 pacemaker-controld  [953383] (stonith__watchdog_fencing_enabled_for_node_api) 	notice: Cluster does not have watchdog fencing device
>Aug 01 10:59:48.383 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-4.raw
>Aug 01 10:59:48.397 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.6.0 of the CIB to disk (digest: 1f5708c803f75d9fa69d1cbba8fd9f52)
>Aug 01 10:59:48.412 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.GQilGF (digest: /var/lib/pacemaker/cib/cib.GG41fL)
>Aug 01 10:59:52.179 rhel93 pacemaker-controld  [953383] (pcmk__procfs_pid_of) 	info: Found pacemaker-based active as process 953378
>Aug 01 10:59:52.179 rhel93 pacemaker-controld  [953383] (throttle_send_command) 	info: New throttle mode: negligible load (was undetermined)
>Aug 01 10:59:53.370 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: b3bb189ab68034c5fc0cd792d2f64a35 for 0.6.0 (0x56133feb9d40 0)
>Aug 01 11:03:02.016 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.6.0 2
>Aug 01 11:03:02.016 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.7.0 dff1077c6fc2630bed8414810d829c08
>Aug 01 11:03:02.016 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=7
>Aug 01 11:03:02.016 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/crm_config/cluster_property_set[@id='cib-bootstrap-options']:  <nvpair id="cib-bootstrap-options-start-failure-is-fat" name="start-failure-is-fatal" value="true"/>
>Aug 01 11:03:02.016 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=rhel91/cibadmin/2, version=0.7.0)
>Aug 01 11:03:02.017 rhel93 pacemaker-controld  [953383] (stonith__watchdog_fencing_enabled_for_node_api) 	notice: Cluster does not have watchdog fencing device
>Aug 01 11:03:02.032 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-5.raw
>Aug 01 11:03:02.047 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.7.0 of the CIB to disk (digest: d837455833b73c6cba601d02343263d5)
>Aug 01 11:03:02.062 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.6atqss (digest: /var/lib/pacemaker/cib/cib.oH1ZbX)
>Aug 01 11:03:07.018 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: dff1077c6fc2630bed8414810d829c08 for 0.7.0 (0x56133feb2020 0)
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.7.0 2
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.0 (null)
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=8
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/resources:  <clone id="ag_cluster-clone"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  <primitive id="ag_cluster" class="ocf" type="ag" provider="mssql">
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <instance_attributes id="ag_cluster-instance_attributes">
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <nvpair id="ag_cluster-instance_attributes-ag_name" name="ag_name" value="ag1"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    </instance_attributes>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <meta_attributes id="ag_cluster-meta_attributes">
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <nvpair id="ag_cluster-meta_attributes-failure-timeout" name="failure-timeout" value="60s"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    </meta_attributes>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <operations>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="demote" interval="0s" timeout="10" id="ag_cluster-demote-interval-0s"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="monitor" interval="10" timeout="60" id="ag_cluster-monitor-interval-10"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="monitor" interval="11" timeout="60" role="Promoted" id="ag_cluster-monitor-interval-11"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="monitor" interval="12" timeout="60" role="Unpromoted" id="ag_cluster-monitor-interval-12"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="notify" interval="0s" timeout="60" id="ag_cluster-notify-interval-0s"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="promote" interval="0s" timeout="60" id="ag_cluster-promote-interval-0s"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="start" interval="0s" timeout="60" id="ag_cluster-start-interval-0s"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                      <op name="stop" interval="0s" timeout="10" id="ag_cluster-stop-interval-0s"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    </operations>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  </primitive>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  <meta_attributes id="ag_cluster-clone-meta_attributes">
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <nvpair id="ag_cluster-clone-meta_attributes-notify" name="notify" value="true"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <nvpair id="ag_cluster-clone-meta_attributes-promotable" name="promotable" value="true"/>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  </meta_attributes>
>Aug 01 11:03:42.096 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                </clone>
>Aug 01 11:03:42.097 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=rhel91/cibadmin/2, version=0.8.0)
>Aug 01 11:03:42.097 rhel93 pacemaker-fenced    [953379] (update_cib_stonith_devices_v2) 	info: Updating device list from CIB: create resources
>Aug 01 11:03:42.097 rhel93 pacemaker-fenced    [953379] (cib_devices_update) 	info: Updating devices to version 0.8.0
>Aug 01 11:03:42.097 rhel93 pacemaker-fenced    [953379] (unpack_config) 	warning: Blind faith: not fencing unseen nodes
>Aug 01 11:03:42.107 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-6.raw
>Aug 01 11:03:42.120 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.8.0 of the CIB to disk (digest: 07233e891f5f4a0d830ecf5331438c6f)
>Aug 01 11:03:42.123 rhel93 pacemaker-execd     [953380] (process_lrmd_get_rsc_info) 	info: Agent information for 'ag_cluster' not in cache
>Aug 01 11:03:42.123 rhel93 pacemaker-execd     [953380] (process_lrmd_get_rsc_info) 	info: Agent information for 'ag_cluster:2' not in cache
>Aug 01 11:03:42.123 rhel93 pacemaker-execd     [953380] (process_lrmd_rsc_register) 	info: Cached agent information for 'ag_cluster'
>Aug 01 11:03:42.123 rhel93 pacemaker-controld  [953383] (do_lrm_invoke) 	info: Retrieving metadata for ag_cluster (ocf:mssql:ag) asynchronously
>Aug 01 11:03:42.129 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.0 2
>Aug 01 11:03:42.129 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.1 (null)
>Aug 01 11:03:42.129 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=1
>Aug 01 11:03:42.129 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='2']:  @crm-debug-origin=do_update_resource
>Aug 01 11:03:42.129 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:  <lrm_resource id="ag_cluster" type="ag" class="ocf" provider="mssql"/>
>Aug 01 11:03:42.129 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                                <lrm_rsc_op id="ag_cluster_last_0" operation_key="ag_cluster_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="2:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;2:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel92" call-id="-1" rc-code="193" op-status="-1" interval="0" last-rc-change="1690913022" exec-time="0" queue-time="0" op-digest="9672526152b2afa3a0cf05537be3c379"/>
>Aug 01 11:03:42.129 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                              </lrm_resource>
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/49, version=0.8.1)
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.1 2
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.2 (null)
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=2
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']:  @crm-debug-origin=do_update_resource
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:  <lrm_resource id="ag_cluster" type="ag" class="ocf" provider="mssql"/>
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                                <lrm_rsc_op id="ag_cluster_last_0" operation_key="ag_cluster_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="1:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;1:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel91" call-id="-1" rc-code="193" op-status="-1" interval="0" last-rc-change="1690913022" exec-time="0" queue-time="0" op-digest="9672526152b2afa3a0cf05537be3c379"/>
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                              </lrm_resource>
>Aug 01 11:03:42.130 rhel93 pacemaker-controld  [953383] (do_lrm_rsc_op) 	notice: Requesting local execution of probe operation for ag_cluster on rhel93 | transition_key=3:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4 op_key=ag_cluster_monitor_0
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/14, version=0.8.2)
>Aug 01 11:03:42.130 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/14)
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.2 2
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.3 (null)
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=3
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='3']:  @crm-debug-origin=do_update_resource
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources:  <lrm_resource id="ag_cluster" type="ag" class="ocf" provider="mssql"/>
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                                <lrm_rsc_op id="ag_cluster_last_0" operation_key="ag_cluster_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="3:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;3:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel93" call-id="-1" rc-code="193" op-status="-1" interval="0" last-rc-change="1690913022" exec-time="0" queue-time="0" op-digest="9672526152b2afa3a0cf05537be3c379"/>
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                              </lrm_resource>
>Aug 01 11:03:42.131 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/14, version=0.8.3)
>Aug 01 11:03:42.132 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.PwQ4Js (digest: /var/lib/pacemaker/cib/cib.1h1LqP)
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: mssql_validate
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: mssql_monitor
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:42 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:42 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]; monitor-interval-timeout [60]
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:42 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:03:42  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:42 Connected to the instance at localhost:1433
>Aug 01 11:03:47.134 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: e24fc365f122f4fd6e283a3dd3c79466 for 0.8.3 (0x56133febe3b0 0)
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:47 Monitor Caller is: monitor.
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:47 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:47 Replica is SECONDARY (2)
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:47 Instance name is rhel93.
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: monitor: 2023/08/01 11:03:47 Current master is .
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:03:47.254 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel92]: (unset) ->  | from rhel92 with no write delay
>Aug 01 11:03:47.254 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 1 private change for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:03:47.254 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel93]: (unset) ->  | from rhel93 with no write delay
>Aug 01 11:03:47.254 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 2 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:03:47.258 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: (unset) -> 20230801180449 | from rhel91 with no write delay
>Aug 01 11:03:47.258 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180449"
>Aug 01 11:03:47.278 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting master-ag_cluster[rhel92]: (unset) -> 10 | from rhel92 with no write delay
>Aug 01 11:03:47.278 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Sent CIB request 6 with 1 change for master-ag_cluster (id n/a, set n/a)
>Aug 01 11:03:47.278 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/attrd/6)
>Aug 01 11:03:47.278 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting master-ag_cluster[rhel93]: (unset) -> 10 | from rhel93 with no write delay
>Aug 01 11:03:47.278 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Write out of 'master-ag_cluster' delayed: update 6 in progress
>Aug 01 11:03:47.278 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.3 2
>Aug 01 11:03:47.278 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.4 (null)
>Aug 01 11:03:47.278 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=4
>Aug 01 11:03:47.278 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='2']/transient_attributes[@id='2']/instance_attributes[@id='status-2']:  <nvpair id="status-2-master-ag_cluster" name="master-ag_cluster" value="10"/>
>Aug 01 11:03:47.278 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/attrd/6, version=0.8.4)
>Aug 01 11:03:47.279 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: CIB update 6 result for master-ag_cluster: OK | rc=0
>Aug 01 11:03:47.279 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * master-ag_cluster[rhel93]=(null)
>Aug 01 11:03:47.279 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * master-ag_cluster[rhel92]=10
>Aug 01 11:03:47.279 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Sent CIB request 7 with 2 changes for master-ag_cluster (id n/a, set n/a)
>Aug 01 11:03:47.279 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/attrd/7)
>Aug 01 11:03:47.279 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.4 2
>Aug 01 11:03:47.279 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.5 (null)
>Aug 01 11:03:47.279 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=5
>Aug 01 11:03:47.279 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='3']/transient_attributes[@id='3']/instance_attributes[@id='status-3']:  <nvpair id="status-3-master-ag_cluster" name="master-ag_cluster" value="10"/>
>Aug 01 11:03:47.279 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/attrd/7, version=0.8.5)
>Aug 01 11:03:47.279 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: CIB update 7 result for master-ag_cluster: OK | rc=0
>Aug 01 11:03:47.279 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * master-ag_cluster[rhel93]=10
>Aug 01 11:03:47.279 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * master-ag_cluster[rhel92]=10
>Aug 01 11:03:47  ag(ag_cluster)[953505]:    INFO: ag_cluster monitor : 0
>Aug 01 11:03:47.281 rhel93 pacemaker-execd     [953380] (log_op_output) 	info: ag_cluster_monitor_0[953505] error output [ resource ag_cluster is NOT running ]
>Aug 01 11:03:47.282 rhel93 pacemaker-controld  [953383] (log_executor_event) 	notice: Result of probe operation for ag_cluster on rhel93: ok | CIB update 15, graph action confirmed; call=6 key=ag_cluster_monitor_0 rc=0
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/15)
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.5 2
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.6 (null)
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=6
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_last_0']:  @transition-magic=0:0;2:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=6, @rc-code=0, @op-status=0, @exec-time=5152
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_last_failure_0" operation_key="ag_cluster_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="2:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="0:0;2:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel92" call-id="6" rc-code="0" op-status="0" interval="0" last-rc-change="1690913022" exec-time="5152" queue-time="0" op-digest="9672526152b2afa3a0cf05537be3c379"/>
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/50, version=0.8.6)
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.6 2
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.7 (null)
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=7
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_last_0']:  @transition-magic=0:0;3:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=6, @rc-code=0, @op-status=0, @exec-time=5149
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_last_failure_0" operation_key="ag_cluster_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="3:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="0:0;3:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel93" call-id="6" rc-code="0" op-status="0" interval="0" last-rc-change="1690913022" exec-time="5149" queue-time="0" op-digest="9672526152b2afa3a0cf05537be3c379"/>
>Aug 01 11:03:47.282 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/15, version=0.8.7)
>Aug 01 11:03:47.283 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting master-ag_cluster[rhel91]: (unset) -> 20 | from rhel91 with no write delay
>Aug 01 11:03:47.283 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Sent CIB request 8 with 3 changes for master-ag_cluster (id n/a, set n/a)
>Aug 01 11:03:47.283 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/attrd/8)
>Aug 01 11:03:47.284 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.7 2
>Aug 01 11:03:47.284 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.8 (null)
>Aug 01 11:03:47.284 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=8
>Aug 01 11:03:47.284 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='1']/transient_attributes[@id='1']/instance_attributes[@id='status-1']:  <nvpair id="status-1-master-ag_cluster" name="master-ag_cluster" value="20"/>
>Aug 01 11:03:47.284 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/attrd/8, version=0.8.8)
>Aug 01 11:03:47.284 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: CIB update 8 result for master-ag_cluster: OK | rc=0
>Aug 01 11:03:47.284 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * master-ag_cluster[rhel91]=20
>Aug 01 11:03:47.284 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * master-ag_cluster[rhel93]=10
>Aug 01 11:03:47.284 rhel93 pacemaker-attrd     [953381] (attrd_cib_callback) 	info: * master-ag_cluster[rhel92]=10
>Aug 01 11:03:47.287 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.8 2
>Aug 01 11:03:47.287 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.9 (null)
>Aug 01 11:03:47.287 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=9
>Aug 01 11:03:47.287 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_last_0']:  @transition-magic=0:8;1:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=6, @rc-code=8, @op-status=0, @exec-time=5155
>Aug 01 11:03:47.287 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_last_failure_0" operation_key="ag_cluster_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="1:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="0:8;1:3:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel91" call-id="6" rc-code="8" op-status="0" interval="0" last-rc-change="1690913022" exec-time="5155" queue-time="0" op-digest="9672526152b2afa3a0cf05537be3c379"/>
>Aug 01 11:03:47.287 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/15, version=0.8.9)
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.9 2
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.10 (null)
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=10
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_monitor_12000" operation_key="ag_cluster_monitor_12000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="4:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;4:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel92" call-id="-1" rc-code="193" op-status="-1" interval="12000" last-rc-change="1690913027" exec-time="0" queue-time="0" op-digest="a5ccb527549b0da2ccce481bc9858999"/>
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/52, version=0.8.10)
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.10 2
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.11 (null)
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=11
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_monitor_10000" operation_key="ag_cluster_monitor_10000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="3:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;3:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel92" call-id="-1" rc-code="193" op-status="-1" interval="10000" last-rc-change="1690913027" exec-time="0" queue-time="0" op-digest="a5ccb527549b0da2ccce481bc9858999"/>
>Aug 01 11:03:47.304 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/53, version=0.8.11)
>Aug 01 11:03:47.304 rhel93 pacemaker-controld  [953383] (do_lrm_rsc_op) 	notice: Requesting local execution of monitor operation for ag_cluster on rhel93 | transition_key=8:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4 op_key=ag_cluster_monitor_12000
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/16)
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.11 2
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.12 (null)
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=12
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_monitor_12000" operation_key="ag_cluster_monitor_12000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="8:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;8:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel93" call-id="-1" rc-code="193" op-status="-1" interval="12000" last-rc-change="1690913027" exec-time="0" queue-time="0" op-digest="a5ccb527549b0da2ccce481bc9858999"/>
>Aug 01 11:03:47.305 rhel93 pacemaker-controld  [953383] (do_lrm_rsc_op) 	notice: Requesting local execution of monitor operation for ag_cluster on rhel93 | transition_key=7:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4 op_key=ag_cluster_monitor_10000
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/16, version=0.8.12)
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/17)
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.12 2
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.13 (null)
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=13
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_monitor_11000" operation_key="ag_cluster_monitor_11000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="13:4:8:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;13:4:8:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel91" call-id="-1" rc-code="193" op-status="-1" interval="11000" last-rc-change="1690913027" exec-time="0" queue-time="0" op-digest="a5ccb527549b0da2ccce481bc9858999"/>
>Aug 01 11:03:47.305 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/16, version=0.8.13)
>Aug 01 11:03:47.306 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.13 2
>Aug 01 11:03:47.306 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.14 (null)
>Aug 01 11:03:47.306 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=14
>Aug 01 11:03:47.306 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources/lrm_resource[@id='ag_cluster']:  <lrm_rsc_op id="ag_cluster_monitor_10000" operation_key="ag_cluster_monitor_10000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="7:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;7:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel93" call-id="-1" rc-code="193" op-status="-1" interval="10000" last-rc-change="1690913027" exec-time="0" queue-time="0" op-digest="a5ccb527549b0da2ccce481bc9858999"/>
>Aug 01 11:03:47.306 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/17, version=0.8.14)
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: mssql_validate
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: mssql_monitor
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:47 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:47 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:47 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:03:47  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:47 Connected to the instance at localhost:1433
>Aug 01 11:03:52.308 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: 74b4f3ce718b94ce96090af12715c31b for 0.8.14 (0x56133febe3b0 0)
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:52 Monitor Caller is: monitor.
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:52 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:52 Replica is SECONDARY (2)
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:52 Instance name is rhel93.
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: monitor: 2023/08/01 11:03:52 Current master is .
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:03:52.415 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180449 -> 20230801180505 | from rhel91 with no write delay
>Aug 01 11:03:52.415 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180505"
>Aug 01 11:03:52  ag(ag_cluster)[953621]:    INFO: ag_cluster monitor : 0
>Aug 01 11:03:52.441 rhel93 pacemaker-controld  [953383] (log_executor_event) 	notice: Result of monitor operation for ag_cluster on rhel93: ok | CIB update 18, graph action unconfirmed; call=7 key=ag_cluster_monitor_12000 rc=0
>Aug 01 11:03:52.441 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/18)
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.14 2
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.15 (null)
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=15
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_monitor_12000']:  @transition-magic=0:0;4:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=7, @rc-code=0, @op-status=0, @exec-time=5137
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/54, version=0.8.15)
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.15 2
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.16 (null)
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=16
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_monitor_12000']:  @transition-magic=0:0;8:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=7, @rc-code=0, @op-status=0, @exec-time=5136
>Aug 01 11:03:52.442 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/18, version=0.8.16)
>Aug 01 11:03:52.446 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.16 2
>Aug 01 11:03:52.446 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.17 (null)
>Aug 01 11:03:52.446 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=17
>Aug 01 11:03:52.446 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_monitor_11000']:  @transition-magic=0:8;13:4:8:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=7, @rc-code=8, @op-status=0, @last-rc-change=1690913032, @exec-time=5140
>Aug 01 11:03:52.447 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/17, version=0.8.17)
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: mssql_validate
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: mssql_monitor
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:52 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:52 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:03:52  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:52 Connected to the instance at localhost:1433
>Aug 01 11:03:57.448 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: 4c1f78ca1222aa8abd6c94f4e21208ad for 0.8.17 (0x56133febe3b0 0)
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:57 Monitor Caller is: monitor.
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:57 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:57 Replica is SECONDARY (2)
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:57 Instance name is rhel93.
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: monitor: 2023/08/01 11:03:57 Current master is .
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180505"
>Aug 01 11:03:57  ag(ag_cluster)[953739]:    INFO: ag_cluster monitor : 0
>Aug 01 11:03:57.573 rhel93 pacemaker-controld  [953383] (log_executor_event) 	notice: Result of monitor operation for ag_cluster on rhel93: ok | CIB update 19, graph action unconfirmed; call=8 key=ag_cluster_monitor_10000 rc=0
>Aug 01 11:03:57.573 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/19)
>Aug 01 11:03:57.573 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.17 2
>Aug 01 11:03:57.573 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.18 (null)
>Aug 01 11:03:57.573 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=18
>Aug 01 11:03:57.573 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_monitor_10000']:  @transition-magic=0:0;7:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=8, @rc-code=0, @op-status=0, @last-rc-change=1690913032, @exec-time=5131, @queue-time=5135
>Aug 01 11:03:57.573 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/19, version=0.8.18)
>Aug 01 11:03:57.575 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.18 2
>Aug 01 11:03:57.575 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.8.19 (null)
>Aug 01 11:03:57.575 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=19
>Aug 01 11:03:57.575 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='ag_cluster']/lrm_rsc_op[@id='ag_cluster_monitor_10000']:  @transition-magic=0:0;3:4:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=8, @rc-code=0, @op-status=0, @last-rc-change=1690913032, @exec-time=5133, @queue-time=5137
>Aug 01 11:03:57.575 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/55, version=0.8.19)
>Aug 01 11:04:02.576 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: ddb7101e1285be69a9c9d05d45e85f76 for 0.8.19 (0x56133febe3b0 0)
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: mssql_validate
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: mssql_monitor
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:04:04  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:04 Connected to the instance at localhost:1433
>Aug 01 11:04:08.550 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180505 -> 20230801180521 | from rhel91 with no write delay
>Aug 01 11:04:08.550 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:09 Monitor Caller is: monitor.
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:09 Replica is SECONDARY (2)
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:09 Instance name is rhel93.
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: monitor: 2023/08/01 11:04:09 Current master is .
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180521"
>Aug 01 11:04:09  ag(ag_cluster)[953861]:    INFO: ag_cluster monitor : 0
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: mssql_validate
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: mssql_monitor
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:09 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:09 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:04:09  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:09 Connected to the instance at localhost:1433
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:14 Monitor Caller is: monitor.
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:14 Replica is SECONDARY (2)
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:14 Instance name is rhel93.
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: monitor: 2023/08/01 11:04:14 Current master is .
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180521"
>Aug 01 11:04:14  ag(ag_cluster)[953977]:    INFO: ag_cluster monitor : 0
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: mssql_validate
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: mssql_monitor
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:04:21  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:21 Connected to the instance at localhost:1433
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.8.19 2
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.0 0d7ff4fc7e37c18d7de70e1dc3b1dfcf
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=9, @num_updates=0
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/resources:  <primitive id="virtualip" class="ocf" type="IPaddr2" provider="heartbeat"/>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  <instance_attributes id="virtualip-instance_attributes">
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <nvpair id="virtualip-instance_attributes-ip" name="ip" value="10.135.65.30"/>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  </instance_attributes>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  <operations>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <op name="monitor" interval="10s" timeout="20s" id="virtualip-monitor-interval-10s"/>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <op name="start" interval="0s" timeout="20s" id="virtualip-start-interval-0s"/>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                    <op name="stop" interval="0s" timeout="20s" id="virtualip-stop-interval-0s"/>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                  </operations>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                </primitive>
>Aug 01 11:04:22.683 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_apply_diff operation for section 'all': OK (rc=0, origin=rhel91/cibadmin/2, version=0.9.0)
>Aug 01 11:04:22.684 rhel93 pacemaker-fenced    [953379] (update_cib_stonith_devices_v2) 	info: Updating device list from CIB: create resources
>Aug 01 11:04:22.684 rhel93 pacemaker-fenced    [953379] (cib_devices_update) 	info: Updating devices to version 0.9.0
>Aug 01 11:04:22.700 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-7.raw
>Aug 01 11:04:22.713 rhel93 pacemaker-execd     [953380] (process_lrmd_get_rsc_info) 	info: Agent information for 'virtualip' not in cache
>Aug 01 11:04:22.713 rhel93 pacemaker-execd     [953380] (process_lrmd_rsc_register) 	info: Cached agent information for 'virtualip'
>Aug 01 11:04:22.713 rhel93 pacemaker-controld  [953383] (do_lrm_invoke) 	info: Retrieving metadata for virtualip (ocf:heartbeat:IPaddr2) asynchronously
>Aug 01 11:04:22.715 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.9.0 of the CIB to disk (digest: d8d0e1f69d8b4087b6cae23b079d7518)
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.0 2
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.1 (null)
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=1
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources:  <lrm_resource id="virtualip" type="IPaddr2" class="ocf" provider="heartbeat"/>
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                                <lrm_rsc_op id="virtualip_last_0" operation_key="virtualip_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="7:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;7:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel92" call-id="-1" rc-code="193" op-status="-1" interval="0" last-rc-change="1690913062" exec-time="0" queue-time="0" op-digest="1875668557da4ce1d39bcf81dfed63ca"/>
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                              </lrm_resource>
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/57, version=0.9.1)
>Aug 01 11:04:22.720 rhel93 pacemaker-controld  [953383] (do_lrm_rsc_op) 	notice: Requesting local execution of probe operation for virtualip on rhel93 | transition_key=8:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4 op_key=virtualip_monitor_0
>Aug 01 11:04:22.720 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/20)
>Aug 01 11:04:22.721 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.1 2
>Aug 01 11:04:22.721 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.2 (null)
>Aug 01 11:04:22.721 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=2
>Aug 01 11:04:22.721 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources:  <lrm_resource id="virtualip" type="IPaddr2" class="ocf" provider="heartbeat"/>
>Aug 01 11:04:22.721 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                                <lrm_rsc_op id="virtualip_last_0" operation_key="virtualip_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="8:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;8:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel93" call-id="-1" rc-code="193" op-status="-1" interval="0" last-rc-change="1690913062" exec-time="0" queue-time="0" op-digest="1875668557da4ce1d39bcf81dfed63ca"/>
>Aug 01 11:04:22.721 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                              </lrm_resource>
>Aug 01 11:04:22.721 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/20, version=0.9.2)
>Aug 01 11:04:22.723 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.2 2
>Aug 01 11:04:22.723 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.3 (null)
>Aug 01 11:04:22.723 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=3
>Aug 01 11:04:22.723 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources:  <lrm_resource id="virtualip" type="IPaddr2" class="ocf" provider="heartbeat"/>
>Aug 01 11:04:22.723 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                                <lrm_rsc_op id="virtualip_last_0" operation_key="virtualip_monitor_0" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="6:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;6:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel91" call-id="-1" rc-code="193" op-status="-1" interval="0" last-rc-change="1690913062" exec-time="0" queue-time="0" op-digest="1875668557da4ce1d39bcf81dfed63ca"/>
>Aug 01 11:04:22.723 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++                                                              </lrm_resource>
>Aug 01 11:04:22.723 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/18, version=0.9.3)
>Aug 01 11:04:22.729 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.n5tFo6 (digest: /var/lib/pacemaker/cib/cib.r23yo3)
>Aug 01 11:04:22.742 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.3 2
>Aug 01 11:04:22.742 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.4 (null)
>Aug 01 11:04:22.742 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=4
>Aug 01 11:04:22.742 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='2']/lrm[@id='2']/lrm_resources/lrm_resource[@id='virtualip']/lrm_rsc_op[@id='virtualip_last_0']:  @transition-magic=0:7;7:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=12, @rc-code=7, @op-status=0, @exec-time=22
>Aug 01 11:04:22.742 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel92/crmd/58, version=0.9.4)
>Aug 01 11:04:22.744 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.4 2
>Aug 01 11:04:22.744 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.5 (null)
>Aug 01 11:04:22.744 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=5
>Aug 01 11:04:22.744 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virtualip']/lrm_rsc_op[@id='virtualip_last_0']:  @transition-magic=0:7;6:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=11, @rc-code=7, @op-status=0, @exec-time=21
>Aug 01 11:04:22.744 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/19, version=0.9.5)
>Aug 01 11:04:22.746 rhel93 pacemaker-controld  [953383] (log_executor_event) 	notice: Result of probe operation for virtualip on rhel93: not running | CIB update 21, graph action confirmed; call=12 key=virtualip_monitor_0 rc=7
>Aug 01 11:04:22.746 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Forwarding cib_modify operation for section status to all (origin=local/crmd/21)
>Aug 01 11:04:22.747 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.5 2
>Aug 01 11:04:22.747 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.6 (null)
>Aug 01 11:04:22.747 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=6
>Aug 01 11:04:22.747 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='3']/lrm[@id='3']/lrm_resources/lrm_resource[@id='virtualip']/lrm_rsc_op[@id='virtualip_last_0']:  @transition-magic=0:7;8:5:7:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=12, @rc-code=7, @op-status=0, @exec-time=25
>Aug 01 11:04:22.747 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel93/crmd/21, version=0.9.6)
>Aug 01 11:04:22.755 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.6 2
>Aug 01 11:04:22.755 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.7 (null)
>Aug 01 11:04:22.755 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=7
>Aug 01 11:04:22.755 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virtualip']/lrm_rsc_op[@id='virtualip_last_0']:  @operation_key=virtualip_start_0, @operation=start, @transition-key=41:5:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @transition-magic=-1:193;41:5:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=-1, @rc-code=193, @op-status=-1, @exec-time=0
>Aug 01 11:04:22.755 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/20, version=0.9.7)
>Aug 01 11:04:22.786 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.7 2
>Aug 01 11:04:22.786 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.8 (null)
>Aug 01 11:04:22.786 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=8
>Aug 01 11:04:22.786 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virtualip']/lrm_rsc_op[@id='virtualip_last_0']:  @transition-magic=0:0;41:5:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=12, @rc-code=0, @op-status=0, @exec-time=30
>Aug 01 11:04:22.787 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/21, version=0.9.8)
>Aug 01 11:04:22.788 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.8 2
>Aug 01 11:04:22.788 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.9 (null)
>Aug 01 11:04:22.788 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=9
>Aug 01 11:04:22.788 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virtualip']:  <lrm_rsc_op id="virtualip_monitor_10000" operation_key="virtualip_monitor_10000" operation="monitor" crm-debug-origin="do_update_resource" crm_feature_set="3.16.2" transition-key="42:5:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" transition-magic="-1:193;42:5:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4" exit-reason="" on_node="rhel91" call-id="-1" rc-code="193" op-status="-1" interval="10000" last-rc-change="1690913062" exec-time="0" queue-time="0" op-digest="2c3f2afdd0017d809047a3ec083e680c"/>
>Aug 01 11:04:22.788 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/22, version=0.9.9)
>Aug 01 11:04:22.809 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.9 2
>Aug 01 11:04:22.809 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.9.10 (null)
>Aug 01 11:04:22.809 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @num_updates=10
>Aug 01 11:04:22.809 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib/status/node_state[@id='1']/lrm[@id='1']/lrm_resources/lrm_resource[@id='virtualip']/lrm_rsc_op[@id='virtualip_monitor_10000']:  @transition-magic=0:0;42:5:0:976395e4-0f30-4f7e-9b5f-1da0b320d7c4, @call-id=13, @rc-code=0, @op-status=0, @exec-time=20
>Aug 01 11:04:22.809 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_modify operation for section status: OK (rc=0, origin=rhel91/crmd/23, version=0.9.10)
>Aug 01 11:04:24.680 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180521 -> 20230801180537 | from rhel91 with no write delay
>Aug 01 11:04:24.680 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:26 Monitor Caller is: monitor.
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:26 Replica is SECONDARY (2)
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:26 Instance name is rhel93.
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: monitor: 2023/08/01 11:04:26 Current master is .
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180537"
>Aug 01 11:04:26  ag(ag_cluster)[954095]:    INFO: ag_cluster monitor : 0
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: mssql_validate
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: mssql_monitor
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:26 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:26 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:04:26  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:26 Connected to the instance at localhost:1433
>Aug 01 11:04:27.810 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: ef6beac77210229610a132c51fc0e0cc for 0.9.10 (0x56133fed9330 0)
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:31 Monitor Caller is: monitor.
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:31 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:31 Replica is SECONDARY (2)
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:31 Instance name is rhel93.
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: monitor: 2023/08/01 11:04:31 Current master is .
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180537"
>Aug 01 11:04:31  ag(ag_cluster)[954257]:    INFO: ag_cluster monitor : 0
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: mssql_validate
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: mssql_monitor
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:38 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:04:38  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:38 Connected to the instance at localhost:1433
>Aug 01 11:04:40.807 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180537 -> 20230801180553 | from rhel91 with no write delay
>Aug 01 11:04:40.807 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:43 Monitor Caller is: monitor.
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:43 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:43 Replica is SECONDARY (2)
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:43 Instance name is rhel93.
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: monitor: 2023/08/01 11:04:43 Current master is .
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180553"
>Aug 01 11:04:43  ag(ag_cluster)[954377]:    INFO: ag_cluster monitor : 0
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: mssql_validate
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: mssql_monitor
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:43 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:43 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:43 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:04:43  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:43 Connected to the instance at localhost:1433
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:48 Monitor Caller is: monitor.
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:48 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:48 Replica is SECONDARY (2)
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:48 Instance name is rhel93.
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: monitor: 2023/08/01 11:04:48 Current master is .
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:04:48  ag(ag_cluster)[954495]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180553"
>Aug 01 11:04:49  ag(ag_cluster)[954495]:    INFO: ag_cluster monitor : 0
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: mssql_validate
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: mssql_monitor
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:04:55 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:04:55 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:04:55 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:04:55  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:04:55 Connected to the instance at localhost:1433
>Aug 01 11:04:56.933 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180553 -> 20230801180609 | from rhel91 with no write delay
>Aug 01 11:04:56.933 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:05:00.218 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.9.10 2
>Aug 01 11:05:00.218 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.10.0 (null)
>Aug 01 11:05:00.218 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=10, @num_updates=0
>Aug 01 11:05:00.218 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/constraints:  <rsc_colocation rsc="virtualip" with-rsc="ag_cluster-clone" score="INFINITY" rsc-role="Started" with-rsc-role="Master" id="colocation-virtualip-ag_cluster-clone-INFINITY"/>
>Aug 01 11:05:00.219 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_replace operation for section configuration: OK (rc=0, origin=rhel91/cibadmin/2, version=0.10.0)
>Aug 01 11:05:00.219 rhel93 pacemaker-fenced    [953379] (update_cib_stonith_devices_v2) 	info: Updating device list from CIB: create constraints
>Aug 01 11:05:00.219 rhel93 pacemaker-fenced    [953379] (cib_devices_update) 	info: Updating devices to version 0.10.0
>Aug 01 11:05:00.230 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-8.raw
>Aug 01 11:05:00.242 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.10.0 of the CIB to disk (digest: b8bda43fbcea30c2cb48c799c34f743b)
>Aug 01 11:05:00.252 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.QKYiNy (digest: /var/lib/pacemaker/cib/cib.fatUOK)
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:05:00 Monitor Caller is: monitor.
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:05:00 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:05:00 Replica is SECONDARY (2)
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:05:00 Instance name is rhel93.
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: monitor: 2023/08/01 11:05:00 Current master is .
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:00  ag(ag_cluster)[954612]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180609"
>Aug 01 11:05:01  ag(ag_cluster)[954612]:    INFO: ag_cluster monitor : 0
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: mssql_validate
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: mssql_monitor
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:01 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:01 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:01 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:05:01  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:01 Connected to the instance at localhost:1433
>Aug 01 11:05:05.222 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: fc5a67d41ccfdd65a9f2ae31b0b7bd5b for 0.10.0 (0x56133fec6aa0 0)
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:06 Monitor Caller is: monitor.
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:06 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:06 Replica is SECONDARY (2)
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:06 Instance name is rhel93.
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: monitor: 2023/08/01 11:05:06 Current master is .
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180609"
>Aug 01 11:05:06  ag(ag_cluster)[954730]:    INFO: ag_cluster monitor : 0
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: mssql_validate
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: mssql_monitor
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:13 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:13 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:13 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:05:13.084 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180609 -> 20230801180626 | from rhel91 with no write delay
>Aug 01 11:05:13.084 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:05:13  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:13 Connected to the instance at localhost:1433
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:18 Monitor Caller is: monitor.
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:18 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:18 Replica is SECONDARY (2)
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:18 Instance name is rhel93.
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: monitor: 2023/08/01 11:05:18 Current master is .
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180626"
>Aug 01 11:05:18  ag(ag_cluster)[954848]:    INFO: ag_cluster monitor : 0
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: mssql_validate
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: mssql_monitor
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:18 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:18 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:18 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:05:18  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:18 Connected to the instance at localhost:1433
>Aug 01 11:05:20.023 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: --- 0.10.0 2
>Aug 01 11:05:20.023 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: Diff: +++ 0.11.0 (null)
>Aug 01 11:05:20.023 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: +  /cib:  @epoch=11
>Aug 01 11:05:20.023 rhel93 pacemaker-based     [953378] (cib_perform_op) 	info: ++ /cib/configuration/constraints:  <rsc_order first="ag_cluster-clone" then="virtualip" first-action="promote" then-action="start" id="order-ag_cluster-clone-virtualip-mandatory"/>
>Aug 01 11:05:20.023 rhel93 pacemaker-based     [953378] (cib_process_request) 	info: Completed cib_replace operation for section configuration: OK (rc=0, origin=rhel91/cibadmin/2, version=0.11.0)
>Aug 01 11:05:20.024 rhel93 pacemaker-fenced    [953379] (update_cib_stonith_devices_v2) 	info: Updating device list from CIB: create constraints
>Aug 01 11:05:20.024 rhel93 pacemaker-fenced    [953379] (cib_devices_update) 	info: Updating devices to version 0.11.0
>Aug 01 11:05:20.039 rhel93 pacemaker-based     [953378] (cib_file_backup) 	info: Archived previous version as /var/lib/pacemaker/cib/cib-9.raw
>Aug 01 11:05:20.054 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Wrote version 0.11.0 of the CIB to disk (digest: 657045a818acc107d95d4d6ff834ee3c)
>Aug 01 11:05:20.068 rhel93 pacemaker-based     [953378] (cib_file_write_with_digest) 	info: Reading cluster configuration file /var/lib/pacemaker/cib/cib.i4RmqB (digest: /var/lib/pacemaker/cib/cib.j7kjn3)
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:23 Monitor Caller is: monitor.
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:23 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:23 Replica is SECONDARY (2)
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:23 Instance name is rhel93.
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: monitor: 2023/08/01 11:05:23 Current master is .
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180626"
>Aug 01 11:05:23  ag(ag_cluster)[954964]:    INFO: ag_cluster monitor : 0
>Aug 01 11:05:25.025 rhel93 pacemaker-based     [953378] (cib_process_ping) 	info: Reporting our current digest to rhel92: 4f446d4cd5b0ecfc3476963d20d96b60 for 0.11.0 (0x56133feb5c80 0)
>Aug 01 11:05:29.214 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180626 -> 20230801180642 | from rhel91 with no write delay
>Aug 01 11:05:29.214 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: mssql_validate
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: mssql_monitor
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:30 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:30 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:30 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:05:30  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:30 Connected to the instance at localhost:1433
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:35 Monitor Caller is: monitor.
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:35 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:35 Replica is SECONDARY (2)
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:35 Instance name is rhel93.
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: monitor: 2023/08/01 11:05:35 Current master is .
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180642"
>Aug 01 11:05:35  ag(ag_cluster)[955085]:    INFO: ag_cluster monitor : 0
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: mssql_validate
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: mssql_monitor
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:35 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:35 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:35 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:05:35  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:35 Connected to the instance at localhost:1433
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:40 Monitor Caller is: monitor.
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:40 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:40 Replica is SECONDARY (2)
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:40 Instance name is rhel93.
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: monitor: 2023/08/01 11:05:40 Current master is .
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180642"
>Aug 01 11:05:40  ag(ag_cluster)[955202]:    INFO: ag_cluster monitor : 0
>Aug 01 11:05:45.342 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180642 -> 20230801180658 | from rhel91 with no write delay
>Aug 01 11:05:45.342 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: mssql_validate
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: mssql_monitor
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:47 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:47 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:47 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:05:47  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:47 Connected to the instance at localhost:1433
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:52 Monitor Caller is: monitor.
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:52 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:52 Replica is SECONDARY (2)
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:52 Instance name is rhel93.
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: monitor: 2023/08/01 11:05:52 Current master is .
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180658"
>Aug 01 11:05:52  ag(ag_cluster)[955321]:    INFO: ag_cluster monitor : 0
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: mssql_validate
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: mssql_monitor
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:52 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:52 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:05:52  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:52 Connected to the instance at localhost:1433
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:57 Monitor Caller is: monitor.
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:57 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:57 Replica is SECONDARY (2)
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:57 Instance name is rhel93.
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: monitor: 2023/08/01 11:05:57 Current master is .
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180658"
>Aug 01 11:05:57  ag(ag_cluster)[955458]:    INFO: ag_cluster monitor : 0
>Aug 01 11:06:01.469 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180658 -> 20230801180714 | from rhel91 with no write delay
>Aug 01 11:06:01.469 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: mssql_validate
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: mssql_monitor
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:06:04  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:04 Connected to the instance at localhost:1433
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:09 Monitor Caller is: monitor.
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:09 Replica is SECONDARY (2)
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:09 Instance name is rhel93.
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: monitor: 2023/08/01 11:06:09 Current master is .
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180714"
>Aug 01 11:06:09  ag(ag_cluster)[955576]:    INFO: ag_cluster monitor : 0
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: mssql_validate
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: mssql_monitor
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:09 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:09 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:06:09  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:09 Connected to the instance at localhost:1433
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:14 Monitor Caller is: monitor.
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:14 Replica is SECONDARY (2)
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:14 Instance name is rhel93.
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: monitor: 2023/08/01 11:06:14 Current master is .
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180714"
>Aug 01 11:06:14  ag(ag_cluster)[955693]:    INFO: ag_cluster monitor : 0
>Aug 01 11:06:17.592 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180714 -> 20230801180730 | from rhel91 with no write delay
>Aug 01 11:06:17.592 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: mssql_validate
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: mssql_monitor
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:06:21  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:21 Connected to the instance at localhost:1433
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:26 Monitor Caller is: monitor.
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:26 Replica is SECONDARY (2)
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:26 Instance name is rhel93.
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: monitor: 2023/08/01 11:06:26 Current master is .
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180730"
>Aug 01 11:06:26  ag(ag_cluster)[955812]:    INFO: ag_cluster monitor : 0
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: mssql_validate
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: mssql_monitor
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:26 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:26 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:06:26  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:26 Connected to the instance at localhost:1433
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:31 Monitor Caller is: monitor.
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:31 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:31 Replica is SECONDARY (2)
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:31 Instance name is rhel93.
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: monitor: 2023/08/01 11:06:31 Current master is .
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180730"
>Aug 01 11:06:31  ag(ag_cluster)[955930]:    INFO: ag_cluster monitor : 0
>Aug 01 11:06:33.737 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180730 -> 20230801180746 | from rhel91 with no write delay
>Aug 01 11:06:33.737 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: mssql_validate
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: mssql_monitor
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:38 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:06:38  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:38 Connected to the instance at localhost:1433
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:43 Monitor Caller is: monitor.
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:43 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:43 Replica is SECONDARY (2)
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:43 Instance name is rhel93.
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: monitor: 2023/08/01 11:06:43 Current master is .
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180746"
>Aug 01 11:06:43  ag(ag_cluster)[956066]:    INFO: ag_cluster monitor : 0
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: mssql_validate
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: mssql_monitor
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:43 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:43 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:43 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:06:43  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:43 Connected to the instance at localhost:1433
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:48 Monitor Caller is: monitor.
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:48 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:48 Replica is SECONDARY (2)
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:48 Instance name is rhel93.
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: monitor: 2023/08/01 11:06:48 Current master is .
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180746"
>Aug 01 11:06:48  ag(ag_cluster)[956221]:    INFO: ag_cluster monitor : 0
>Aug 01 11:06:49.886 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180746 -> 20230801180802 | from rhel91 with no write delay
>Aug 01 11:06:49.886 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: mssql_validate
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: mssql_monitor
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:06:55 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:06:55 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:06:55 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:06:55  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:06:55 Connected to the instance at localhost:1433
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:07:00 Monitor Caller is: monitor.
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:07:00 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:07:00 Replica is SECONDARY (2)
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:07:00 Instance name is rhel93.
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: monitor: 2023/08/01 11:07:00 Current master is .
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180802"
>Aug 01 11:07:00  ag(ag_cluster)[956358]:    INFO: ag_cluster monitor : 0
>Aug 01 11:07:00  ag(ag_cluster)[956475]:    INFO: mssql_validate
>Aug 01 11:07:00  ag(ag_cluster)[956475]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:07:00  ag(ag_cluster)[956475]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:07:00  ag(ag_cluster)[956475]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:07:00  ag(ag_cluster)[956475]:    INFO: mssql_monitor
>Aug 01 11:07:01  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:01 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:07:01  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:01 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:07:01  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:01 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:07:01  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:01 Connected to the instance at localhost:1433
>Aug 01 11:07:06.044 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180802 -> 20230801180819 | from rhel91 with no write delay
>Aug 01 11:07:06.044 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:06 Monitor Caller is: monitor.
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:06 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:06 Replica is SECONDARY (2)
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:06 Instance name is rhel93.
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: monitor: 2023/08/01 11:07:06 Current master is .
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180819"
>Aug 01 11:07:06  ag(ag_cluster)[956475]:    INFO: ag_cluster monitor : 0
>Aug 01 11:07:12  ag(ag_cluster)[956669]:    INFO: mssql_validate
>Aug 01 11:07:12  ag(ag_cluster)[956669]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:07:12  ag(ag_cluster)[956669]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:07:12  ag(ag_cluster)[956669]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:07:12  ag(ag_cluster)[956669]:    INFO: mssql_monitor
>Aug 01 11:07:13  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:13 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:07:13  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:13 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:07:13  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:13 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:07:13  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:13 Connected to the instance at localhost:1433
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:18 Monitor Caller is: monitor.
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:18 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:18 Replica is SECONDARY (2)
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:18 Instance name is rhel93.
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: monitor: 2023/08/01 11:07:18 Current master is .
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180819"
>Aug 01 11:07:18  ag(ag_cluster)[956669]:    INFO: ag_cluster monitor : 0
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: mssql_validate
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: mssql_monitor
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:18 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:18 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:18 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:07:18  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:18 Connected to the instance at localhost:1433
>Aug 01 11:07:22.203 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180819 -> 20230801180835 | from rhel91 with no write delay
>Aug 01 11:07:22.203 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:23 Monitor Caller is: monitor.
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:23 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:23 Replica is SECONDARY (2)
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:23 Instance name is rhel93.
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: monitor: 2023/08/01 11:07:23 Current master is .
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180835"
>Aug 01 11:07:23  ag(ag_cluster)[956786]:    INFO: ag_cluster monitor : 0
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: mssql_validate
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: mssql_monitor
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:30 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:30 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:30 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:07:30  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:30 Connected to the instance at localhost:1433
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:35 Monitor Caller is: monitor.
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:35 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:35 Replica is SECONDARY (2)
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:35 Instance name is rhel93.
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: monitor: 2023/08/01 11:07:35 Current master is .
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180835"
>Aug 01 11:07:35  ag(ag_cluster)[956905]:    INFO: ag_cluster monitor : 0
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: mssql_validate
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: mssql_monitor
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:35 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:35 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:35 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:07:35  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:35 Connected to the instance at localhost:1433
>Aug 01 11:07:38.351 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180835 -> 20230801180851 | from rhel91 with no write delay
>Aug 01 11:07:38.351 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:40 Monitor Caller is: monitor.
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:40 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:40 Replica is SECONDARY (2)
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:40 Instance name is rhel93.
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: monitor: 2023/08/01 11:07:40 Current master is .
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180851"
>Aug 01 11:07:40  ag(ag_cluster)[957022]:    INFO: ag_cluster monitor : 0
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: mssql_validate
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: mssql_monitor
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:47 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:47 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:47 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:07:47  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:47 Connected to the instance at localhost:1433
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:52 Monitor Caller is: monitor.
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:52 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:52 Replica is SECONDARY (2)
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:52 Instance name is rhel93.
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: monitor: 2023/08/01 11:07:52 Current master is .
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180851"
>Aug 01 11:07:52  ag(ag_cluster)[957140]:    INFO: ag_cluster monitor : 0
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: mssql_validate
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: mssql_monitor
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:52 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:52 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:07:52  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:52 Connected to the instance at localhost:1433
>Aug 01 11:07:54.474 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180851 -> 20230801180907 | from rhel91 with no write delay
>Aug 01 11:07:54.474 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:57 Monitor Caller is: monitor.
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:57 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:57 Replica is SECONDARY (2)
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:57 Instance name is rhel93.
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: monitor: 2023/08/01 11:07:57 Current master is .
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180907"
>Aug 01 11:07:57  ag(ag_cluster)[957257]:    INFO: ag_cluster monitor : 0
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: mssql_validate
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: mssql_monitor
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:08:04  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:04 Connected to the instance at localhost:1433
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:09 Monitor Caller is: monitor.
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:09 Replica is SECONDARY (2)
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:09 Instance name is rhel93.
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: monitor: 2023/08/01 11:08:09 Current master is .
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180907"
>Aug 01 11:08:09  ag(ag_cluster)[957377]:    INFO: ag_cluster monitor : 0
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: mssql_validate
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: mssql_monitor
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:09 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:09 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:08:09  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:09 Connected to the instance at localhost:1433
>Aug 01 11:08:10.623 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180907 -> 20230801180923 | from rhel91 with no write delay
>Aug 01 11:08:10.623 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:14 Monitor Caller is: monitor.
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:14 Replica is SECONDARY (2)
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:14 Instance name is rhel93.
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: monitor: 2023/08/01 11:08:14 Current master is .
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180923"
>Aug 01 11:08:14  ag(ag_cluster)[957494]:    INFO: ag_cluster monitor : 0
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: mssql_validate
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: mssql_monitor
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:08:21  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:21 Connected to the instance at localhost:1433
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:26 Monitor Caller is: monitor.
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:26 Replica is SECONDARY (2)
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:26 Instance name is rhel93.
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: monitor: 2023/08/01 11:08:26 Current master is .
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180923"
>Aug 01 11:08:26  ag(ag_cluster)[957614]:    INFO: ag_cluster monitor : 0
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: mssql_validate
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: mssql_monitor
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:26 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:26 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:08:26.751 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180923 -> 20230801180939 | from rhel91 with no write delay
>Aug 01 11:08:26.751 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:08:26  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:26 Connected to the instance at localhost:1433
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:31 Monitor Caller is: monitor.
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:31 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:31 Replica is SECONDARY (2)
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:31 Instance name is rhel93.
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: monitor: 2023/08/01 11:08:31 Current master is .
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180939"
>Aug 01 11:08:31  ag(ag_cluster)[957732]:    INFO: ag_cluster monitor : 0
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: mssql_validate
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: mssql_monitor
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:38 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:08:38  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:38 Connected to the instance at localhost:1433
>Aug 01 11:08:42.901 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180939 -> 20230801180955 | from rhel91 with no write delay
>Aug 01 11:08:42.901 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:43 Monitor Caller is: monitor.
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:43 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:43 Replica is SECONDARY (2)
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:43 Instance name is rhel93.
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: monitor: 2023/08/01 11:08:43 Current master is .
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180955"
>Aug 01 11:08:43  ag(ag_cluster)[957849]:    INFO: ag_cluster monitor : 0
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: mssql_validate
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: mssql_monitor
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:43 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:43 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:43 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:08:43  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:43 Connected to the instance at localhost:1433
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:48 Monitor Caller is: monitor.
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:48 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:48 Replica is SECONDARY (2)
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:48 Instance name is rhel93.
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: monitor: 2023/08/01 11:08:48 Current master is .
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801180955"
>Aug 01 11:08:48  ag(ag_cluster)[957967]:    INFO: ag_cluster monitor : 0
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: mssql_validate
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: mssql_monitor
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:08:55 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:08:55 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:08:55 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:08:55  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:08:55 Connected to the instance at localhost:1433
>Aug 01 11:08:59.052 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801180955 -> 20230801181012 | from rhel91 with no write delay
>Aug 01 11:08:59.052 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:09:00 Monitor Caller is: monitor.
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:09:00 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:09:00 Replica is SECONDARY (2)
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:09:00 Instance name is rhel93.
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: monitor: 2023/08/01 11:09:00 Current master is .
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181012"
>Aug 01 11:09:00  ag(ag_cluster)[958084]:    INFO: ag_cluster monitor : 0
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: mssql_validate
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: mssql_monitor
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:00 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:00 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:09:00  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:00 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:09:01  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:01 Connected to the instance at localhost:1433
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:06 Monitor Caller is: monitor.
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:06 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:06 Replica is SECONDARY (2)
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:06 Instance name is rhel93.
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: monitor: 2023/08/01 11:09:06 Current master is .
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181012"
>Aug 01 11:09:06  ag(ag_cluster)[958202]:    INFO: ag_cluster monitor : 0
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: mssql_validate
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: mssql_monitor
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:12 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:12 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:09:12  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:12 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:09:13  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:13 Connected to the instance at localhost:1433
>Aug 01 11:09:15.179 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181012 -> 20230801181028 | from rhel91 with no write delay
>Aug 01 11:09:15.179 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:18 Monitor Caller is: monitor.
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:18 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:18 Replica is SECONDARY (2)
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:18 Instance name is rhel93.
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: monitor: 2023/08/01 11:09:18 Current master is .
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181028"
>Aug 01 11:09:18  ag(ag_cluster)[958319]:    INFO: ag_cluster monitor : 0
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: mssql_validate
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: mssql_monitor
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:18 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:18 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:18 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:09:18  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:18 Connected to the instance at localhost:1433
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:23 Monitor Caller is: monitor.
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:23 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:23 Replica is SECONDARY (2)
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:23 Instance name is rhel93.
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: monitor: 2023/08/01 11:09:23 Current master is .
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181028"
>Aug 01 11:09:23  ag(ag_cluster)[958435]:    INFO: ag_cluster monitor : 0
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: mssql_validate
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: mssql_monitor
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:30 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:30 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:30 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:09:30  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:30 Connected to the instance at localhost:1433
>Aug 01 11:09:31.306 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181028 -> 20230801181044 | from rhel91 with no write delay
>Aug 01 11:09:31.306 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:35 Monitor Caller is: monitor.
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:35 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:35 Replica is SECONDARY (2)
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:35 Instance name is rhel93.
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: monitor: 2023/08/01 11:09:35 Current master is .
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181044"
>Aug 01 11:09:35  ag(ag_cluster)[958554]:    INFO: ag_cluster monitor : 0
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: mssql_validate
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: mssql_monitor
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:35 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:35 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:35 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:09:35  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:35 Connected to the instance at localhost:1433
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:40 Monitor Caller is: monitor.
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:40 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:40 Replica is SECONDARY (2)
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:40 Instance name is rhel93.
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: monitor: 2023/08/01 11:09:40 Current master is .
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181044"
>Aug 01 11:09:40  ag(ag_cluster)[958671]:    INFO: ag_cluster monitor : 0
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: mssql_validate
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: mssql_monitor
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:47 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:47 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:47 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:09:47  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:47 Connected to the instance at localhost:1433
>Aug 01 11:09:47.430 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181044 -> 20230801181100 | from rhel91 with no write delay
>Aug 01 11:09:47.430 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:52 Monitor Caller is: monitor.
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:52 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:52 Replica is SECONDARY (2)
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:52 Instance name is rhel93.
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: monitor: 2023/08/01 11:09:52 Current master is .
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181100"
>Aug 01 11:09:52  ag(ag_cluster)[958790]:    INFO: ag_cluster monitor : 0
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: mssql_validate
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: mssql_monitor
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:52 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:52 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:09:52  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:52 Connected to the instance at localhost:1433
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:57 Monitor Caller is: monitor.
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:57 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:57 Replica is SECONDARY (2)
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:57 Instance name is rhel93.
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: monitor: 2023/08/01 11:09:57 Current master is .
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181100"
>Aug 01 11:09:57  ag(ag_cluster)[958913]:    INFO: ag_cluster monitor : 0
>Aug 01 11:10:03.552 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181100 -> 20230801181116 | from rhel91 with no write delay
>Aug 01 11:10:03.552 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: mssql_validate
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: mssql_monitor
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:10:04  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:04 Connected to the instance at localhost:1433
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:09 Monitor Caller is: monitor.
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:09 Replica is SECONDARY (2)
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:09 Instance name is rhel93.
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: monitor: 2023/08/01 11:10:09 Current master is .
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181116"
>Aug 01 11:10:09  ag(ag_cluster)[959033]:    INFO: ag_cluster monitor : 0
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: mssql_validate
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: mssql_monitor
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:09 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:09 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:10:09  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:09 Connected to the instance at localhost:1433
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:14 Monitor Caller is: monitor.
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:14 Replica is SECONDARY (2)
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:14 Instance name is rhel93.
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: monitor: 2023/08/01 11:10:14 Current master is .
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181116"
>Aug 01 11:10:14  ag(ag_cluster)[959149]:    INFO: ag_cluster monitor : 0
>Aug 01 11:10:19.688 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181116 -> 20230801181132 | from rhel91 with no write delay
>Aug 01 11:10:19.688 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: mssql_validate
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: mssql_monitor
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:10:21  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:21 Connected to the instance at localhost:1433
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:26 Monitor Caller is: monitor.
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:26 Replica is SECONDARY (2)
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:26 Instance name is rhel93.
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: monitor: 2023/08/01 11:10:26 Current master is .
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181132"
>Aug 01 11:10:26  ag(ag_cluster)[959267]:    INFO: ag_cluster monitor : 0
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: mssql_validate
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: mssql_monitor
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:26 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:26 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:10:26  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:26 Connected to the instance at localhost:1433
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:31 Monitor Caller is: monitor.
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:31 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:31 Replica is SECONDARY (2)
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:31 Instance name is rhel93.
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: monitor: 2023/08/01 11:10:31 Current master is .
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181132"
>Aug 01 11:10:31  ag(ag_cluster)[959385]:    INFO: ag_cluster monitor : 0
>Aug 01 11:10:35.835 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181132 -> 20230801181148 | from rhel91 with no write delay
>Aug 01 11:10:35.835 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: mssql_validate
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: mssql_monitor
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:38 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:10:38  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:38 Connected to the instance at localhost:1433
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:43 Monitor Caller is: monitor.
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:43 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:43 Replica is SECONDARY (2)
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:43 Instance name is rhel93.
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: monitor: 2023/08/01 11:10:43 Current master is .
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181148"
>Aug 01 11:10:43  ag(ag_cluster)[959504]:    INFO: ag_cluster monitor : 0
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: mssql_validate
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: mssql_monitor
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:43 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:43 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:43 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:10:43  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:43 Connected to the instance at localhost:1433
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:48 Monitor Caller is: monitor.
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:48 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:48 Replica is SECONDARY (2)
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:48 Instance name is rhel93.
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: monitor: 2023/08/01 11:10:48 Current master is .
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181148"
>Aug 01 11:10:48  ag(ag_cluster)[959622]:    INFO: ag_cluster monitor : 0
>Aug 01 11:10:51.985 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181148 -> 20230801181204 | from rhel91 with no write delay
>Aug 01 11:10:51.985 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: mssql_validate
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: mssql_monitor
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:10:55 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:10:55 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:10:55 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:10:55  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:10:55 Connected to the instance at localhost:1433
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:11:00 Monitor Caller is: monitor.
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:11:00 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:11:00 Replica is SECONDARY (2)
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:11:00 Instance name is rhel93.
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: monitor: 2023/08/01 11:11:00 Current master is .
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181204"
>Aug 01 11:11:00  ag(ag_cluster)[959740]:    INFO: ag_cluster monitor : 0
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: mssql_validate
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: mssql_monitor
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:00 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:00 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:11:00  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:00 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:11:01  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:01 Connected to the instance at localhost:1433
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:06 Monitor Caller is: monitor.
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:06 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:06 Replica is SECONDARY (2)
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:06 Instance name is rhel93.
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: monitor: 2023/08/01 11:11:06 Current master is .
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181204"
>Aug 01 11:11:06  ag(ag_cluster)[959858]:    INFO: ag_cluster monitor : 0
>Aug 01 11:11:08.109 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181204 -> 20230801181221 | from rhel91 with no write delay
>Aug 01 11:11:08.109 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: mssql_validate
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: mssql_monitor
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:12 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:12 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:11:12  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:12 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:11:13  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:13 Connected to the instance at localhost:1433
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:18 Monitor Caller is: monitor.
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:18 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:18 Replica is SECONDARY (2)
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:18 Instance name is rhel93.
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: monitor: 2023/08/01 11:11:18 Current master is .
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181221"
>Aug 01 11:11:18  ag(ag_cluster)[959975]:    INFO: ag_cluster monitor : 0
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: mssql_validate
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: mssql_monitor
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:18 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:18 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:18 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:11:18  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:18 Connected to the instance at localhost:1433
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:23 Monitor Caller is: monitor.
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:23 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:23 Replica is SECONDARY (2)
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:23 Instance name is rhel93.
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: monitor: 2023/08/01 11:11:23 Current master is .
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181221"
>Aug 01 11:11:23  ag(ag_cluster)[960095]:    INFO: ag_cluster monitor : 0
>Aug 01 11:11:24.231 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181221 -> 20230801181237 | from rhel91 with no write delay
>Aug 01 11:11:24.232 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: mssql_validate
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: mssql_monitor
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:30 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:30 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:30 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:11:30  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:30 Connected to the instance at localhost:1433
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:35 Monitor Caller is: monitor.
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:35 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:35 Replica is SECONDARY (2)
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:35 Instance name is rhel93.
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: monitor: 2023/08/01 11:11:35 Current master is .
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181237"
>Aug 01 11:11:35  ag(ag_cluster)[960214]:    INFO: ag_cluster monitor : 0
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: mssql_validate
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: mssql_monitor
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:35 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:35 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:35 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:11:35  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:35 Connected to the instance at localhost:1433
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:40 Monitor Caller is: monitor.
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:40 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:40 Replica is SECONDARY (2)
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:40 Instance name is rhel93.
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: monitor: 2023/08/01 11:11:40 Current master is .
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181237"
>Aug 01 11:11:40  ag(ag_cluster)[960332]:    INFO: ag_cluster monitor : 0
>Aug 01 11:11:40.365 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181237 -> 20230801181253 | from rhel91 with no write delay
>Aug 01 11:11:40.365 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: mssql_validate
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: mssql_monitor
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:47 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:47 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:47 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:11:47  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:47 Connected to the instance at localhost:1433
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:52 Monitor Caller is: monitor.
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:52 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:52 Replica is SECONDARY (2)
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:52 Instance name is rhel93.
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: monitor: 2023/08/01 11:11:52 Current master is .
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181253"
>Aug 01 11:11:52  ag(ag_cluster)[960464]:    INFO: ag_cluster monitor : 0
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: mssql_validate
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: mssql_monitor
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:52 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:52 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:11:52  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:52 Connected to the instance at localhost:1433
>Aug 01 11:11:56.491 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181253 -> 20230801181309 | from rhel91 with no write delay
>Aug 01 11:11:56.491 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:57 Monitor Caller is: monitor.
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:57 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:57 Replica is SECONDARY (2)
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:57 Instance name is rhel93.
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: monitor: 2023/08/01 11:11:57 Current master is .
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181309"
>Aug 01 11:11:57  ag(ag_cluster)[960582]:    INFO: ag_cluster monitor : 0
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: mssql_validate
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: mssql_monitor
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:12:04  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:04 Connected to the instance at localhost:1433
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:09 Monitor Caller is: monitor.
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:09 Replica is SECONDARY (2)
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:09 Instance name is rhel93.
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: monitor: 2023/08/01 11:12:09 Current master is .
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181309"
>Aug 01 11:12:09  ag(ag_cluster)[960700]:    INFO: ag_cluster monitor : 0
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: mssql_validate
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: mssql_monitor
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:09 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:09 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:12:09  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:09 Connected to the instance at localhost:1433
>Aug 01 11:12:12.614 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181309 -> 20230801181325 | from rhel91 with no write delay
>Aug 01 11:12:12.614 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:14 Monitor Caller is: monitor.
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:14 Replica is SECONDARY (2)
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:14 Instance name is rhel93.
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: monitor: 2023/08/01 11:12:14 Current master is .
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181325"
>Aug 01 11:12:14  ag(ag_cluster)[960816]:    INFO: ag_cluster monitor : 0
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: mssql_validate
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: mssql_monitor
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:12:21  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:21 Connected to the instance at localhost:1433
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:26 Monitor Caller is: monitor.
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:26 Replica is SECONDARY (2)
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:26 Instance name is rhel93.
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: monitor: 2023/08/01 11:12:26 Current master is .
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181325"
>Aug 01 11:12:26  ag(ag_cluster)[960934]:    INFO: ag_cluster monitor : 0
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: mssql_validate
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: mssql_monitor
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:26 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:26 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:12:26  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:26 Connected to the instance at localhost:1433
>Aug 01 11:12:28.760 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181325 -> 20230801181341 | from rhel91 with no write delay
>Aug 01 11:12:28.760 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:31 Monitor Caller is: monitor.
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:31 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:31 Replica is SECONDARY (2)
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:31 Instance name is rhel93.
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: monitor: 2023/08/01 11:12:31 Current master is .
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181341"
>Aug 01 11:12:31  ag(ag_cluster)[961051]:    INFO: ag_cluster monitor : 0
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: mssql_validate
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: mssql_monitor
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:38 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:12:38  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:38 Connected to the instance at localhost:1433
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:43 Monitor Caller is: monitor.
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:43 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:43 Replica is SECONDARY (2)
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:43 Instance name is rhel93.
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: monitor: 2023/08/01 11:12:43 Current master is .
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181341"
>Aug 01 11:12:43  ag(ag_cluster)[961168]:    INFO: ag_cluster monitor : 0
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: mssql_validate
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: mssql_monitor
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:43 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:43 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:43 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:12:43  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:43 Connected to the instance at localhost:1433
>Aug 01 11:12:44.903 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181341 -> 20230801181357 | from rhel91 with no write delay
>Aug 01 11:12:44.904 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:48 Monitor Caller is: monitor.
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:48 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:48 Replica is SECONDARY (2)
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:48 Instance name is rhel93.
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: monitor: 2023/08/01 11:12:48 Current master is .
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181357"
>Aug 01 11:12:48  ag(ag_cluster)[961285]:    INFO: ag_cluster monitor : 0
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: mssql_validate
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: mssql_monitor
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:12:55 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:12:55 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:12:55 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:12:55  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:12:55 Connected to the instance at localhost:1433
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:13:00 Monitor Caller is: monitor.
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:13:00 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:13:00 Replica is SECONDARY (2)
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:13:00 Instance name is rhel93.
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: monitor: 2023/08/01 11:13:00 Current master is .
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181357"
>Aug 01 11:13:00  ag(ag_cluster)[961402]:    INFO: ag_cluster monitor : 0
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: mssql_validate
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: mssql_monitor
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:00 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:00 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:00 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:13:00  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:00 Connected to the instance at localhost:1433
>Aug 01 11:13:01.032 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181357 -> 20230801181414 | from rhel91 with no write delay
>Aug 01 11:13:01.032 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:13:05  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:05 Monitor Caller is: monitor.
>Aug 01 11:13:05  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:05 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:05  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:05 Replica is SECONDARY (2)
>Aug 01 11:13:05  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:05 Instance name is rhel93.
>Aug 01 11:13:05  ag(ag_cluster)[961519]:    INFO: monitor: 2023/08/01 11:13:05 Current master is .
>Aug 01 11:13:05  ag(ag_cluster)[961519]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:06  ag(ag_cluster)[961519]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:06  ag(ag_cluster)[961519]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181414"
>Aug 01 11:13:06  ag(ag_cluster)[961519]:    INFO: ag_cluster monitor : 0
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: mssql_validate
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: mssql_monitor
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:12 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:12 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:12 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:13:12  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:12 Connected to the instance at localhost:1433
>Aug 01 11:13:17.158 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181414 -> 20230801181430 | from rhel91 with no write delay
>Aug 01 11:13:17.158 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:13:17  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:17 Monitor Caller is: monitor.
>Aug 01 11:13:17  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:17 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:17  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:17 Replica is SECONDARY (2)
>Aug 01 11:13:17  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:17 Instance name is rhel93.
>Aug 01 11:13:17  ag(ag_cluster)[961638]:    INFO: monitor: 2023/08/01 11:13:17 Current master is .
>Aug 01 11:13:17  ag(ag_cluster)[961638]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:18  ag(ag_cluster)[961638]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:18  ag(ag_cluster)[961638]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181430"
>Aug 01 11:13:18  ag(ag_cluster)[961638]:    INFO: ag_cluster monitor : 0
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: mssql_validate
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: mssql_monitor
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:18 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:18 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:18 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:13:18  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:18 Connected to the instance at localhost:1433
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:23 Monitor Caller is: monitor.
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:23 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:23 Replica is SECONDARY (2)
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:23 Instance name is rhel93.
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: monitor: 2023/08/01 11:13:23 Current master is .
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181430"
>Aug 01 11:13:23  ag(ag_cluster)[961755]:    INFO: ag_cluster monitor : 0
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: mssql_validate
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: mssql_monitor
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:30 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:30 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:30 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:13:30  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:30 Connected to the instance at localhost:1433
>Aug 01 11:13:33.286 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181430 -> 20230801181446 | from rhel91 with no write delay
>Aug 01 11:13:33.286 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:35 Monitor Caller is: monitor.
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:35 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:35 Replica is SECONDARY (2)
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:35 Instance name is rhel93.
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: monitor: 2023/08/01 11:13:35 Current master is .
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181446"
>Aug 01 11:13:35  ag(ag_cluster)[961874]:    INFO: ag_cluster monitor : 0
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: mssql_validate
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: mssql_monitor
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:35 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:35 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:35 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:13:35  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:35 Connected to the instance at localhost:1433
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:40 Monitor Caller is: monitor.
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:40 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:40 Replica is SECONDARY (2)
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:40 Instance name is rhel93.
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: monitor: 2023/08/01 11:13:40 Current master is .
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181446"
>Aug 01 11:13:40  ag(ag_cluster)[961991]:    INFO: ag_cluster monitor : 0
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: mssql_validate
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: mssql_monitor
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:47 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:47 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:47 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:13:47  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:47 Connected to the instance at localhost:1433
>Aug 01 11:13:49.414 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181446 -> 20230801181502 | from rhel91 with no write delay
>Aug 01 11:13:49.414 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:52 Monitor Caller is: monitor.
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:52 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:52 Replica is SECONDARY (2)
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:52 Instance name is rhel93.
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: monitor: 2023/08/01 11:13:52 Current master is .
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181502"
>Aug 01 11:13:52  ag(ag_cluster)[962109]:    INFO: ag_cluster monitor : 0
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: mssql_validate
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: mssql_monitor
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:52 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:52 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:13:52  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:52 Connected to the instance at localhost:1433
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:57 Monitor Caller is: monitor.
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:57 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:57 Replica is SECONDARY (2)
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:57 Instance name is rhel93.
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: monitor: 2023/08/01 11:13:57 Current master is .
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181502"
>Aug 01 11:13:57  ag(ag_cluster)[962226]:    INFO: ag_cluster monitor : 0
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: mssql_validate
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: mssql_monitor
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:14:04  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:04 Connected to the instance at localhost:1433
>Aug 01 11:14:05.542 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181502 -> 20230801181518 | from rhel91 with no write delay
>Aug 01 11:14:05.542 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:09 Monitor Caller is: monitor.
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:09 Replica is SECONDARY (2)
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:09 Instance name is rhel93.
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: monitor: 2023/08/01 11:14:09 Current master is .
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181518"
>Aug 01 11:14:09  ag(ag_cluster)[962344]:    INFO: ag_cluster monitor : 0
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: mssql_validate
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: mssql_monitor
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:09 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:09 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:14:09  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:09 Connected to the instance at localhost:1433
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:14 Monitor Caller is: monitor.
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:14 Replica is SECONDARY (2)
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:14 Instance name is rhel93.
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: monitor: 2023/08/01 11:14:14 Current master is .
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181518"
>Aug 01 11:14:14  ag(ag_cluster)[962461]:    INFO: ag_cluster monitor : 0
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: mssql_validate
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: mssql_monitor
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:14:21  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:21 Connected to the instance at localhost:1433
>Aug 01 11:14:21.690 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181518 -> 20230801181534 | from rhel91 with no write delay
>Aug 01 11:14:21.690 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:26 Monitor Caller is: monitor.
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:26 Replica is SECONDARY (2)
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:26 Instance name is rhel93.
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: monitor: 2023/08/01 11:14:26 Current master is .
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181534"
>Aug 01 11:14:26  ag(ag_cluster)[962580]:    INFO: ag_cluster monitor : 0
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: mssql_validate
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: mssql_monitor
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:26 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:26 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:14:26  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:26 Connected to the instance at localhost:1433
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:31 Monitor Caller is: monitor.
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:31 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance rhel93
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:31 Replica is SECONDARY (2)
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:31 Instance name is rhel93.
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: monitor: 2023/08/01 11:14:31 Current master is .
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: monitor: PROMOTION_SCORE: 10
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: lease_expiry after monitor update: 
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="rhel92" value=""
>name="ag_cluster-lease-expiry" host="rhel93" value=""
>name="ag_cluster-lease-expiry" host="rhel91" value="20230801181534"
>Aug 01 11:14:31  ag(ag_cluster)[962696]:    INFO: ag_cluster monitor : 0
>Aug 01 11:14:37.819 rhel93 pacemaker-attrd     [953381] (update_attr_on_host) 	notice: Setting ag_cluster-lease-expiry[rhel91]: 20230801181534 -> 20230801181550 | from rhel91 with no write delay
>Aug 01 11:14:37.819 rhel93 pacemaker-attrd     [953381] (attrd_write_attribute) 	info: Processed 3 private changes for ag_cluster-lease-expiry, id=n/a, set=n/a
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: mssql_validate
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: Resource agent invoked with: monitor
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: mssql_monitor
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: monitor: 2023/08/01 11:14:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: monitor: 2023/08/01 11:14:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: monitor: 2023/08/01 11:14:38 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Aug 01 11:14:38  ag(ag_cluster)[962836]:    INFO: monitor: 2023/08/01 11:14:38 Connected to the instance at localhost:1433

Actions: View

Attachments on bug 2224249: 1976688 | 1976689 | 1980299 | 1980300 | 1981341 | 1981342 | 1981343