Attachment 1976686 Details for Bug 2221772 – pacemaker logs_updated

pacemaker logs_updated

pacemaker3_7_19.log (text/plain), 304.06 KB, created by Aravind Mahadevan on 2023-07-20 09:09:20 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Aravind Mahadevan

Created: 2023-07-20 09:09:20 UTC

Size: 304.06 KB

patch

obsolete

>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: mssql_validate
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: mssql_monitor
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:03 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:03 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server1]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:03 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:38:03  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:03 Connected to the instance at localhost:1433
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:08 Monitor Caller is: monitor.
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:08 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:08 Replica is SECONDARY (2)
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:08 Instance name is server3.
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: monitor: 2023/07/19 14:38:08 Current master is server1.
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:38:08  ag(ag_cluster)[46462]:    INFO: ag_cluster monitor : 0
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: mssql_validate
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: mssql_monitor
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:08 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:08 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server1]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:08 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:38:08  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:08 Connected to the instance at localhost:1433
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:13 Monitor Caller is: monitor.
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:13 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:13 Replica is SECONDARY (2)
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:13 Instance name is server3.
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: monitor: 2023/07/19 14:38:13 Current master is server1.
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:38:13  ag(ag_cluster)[46616]:    INFO: ag_cluster monitor : 0
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: mssql_validate
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: mssql_monitor
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:20 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:20 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server1]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:20 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:38:20  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:20 Connected to the instance at localhost:1433
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:25 Monitor Caller is: monitor.
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:25 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:25 Replica is SECONDARY (2)
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:25 Instance name is server3.
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: monitor: 2023/07/19 14:38:25 Current master is server1.
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:38:25  ag(ag_cluster)[46770]:    INFO: ag_cluster monitor : 0
>Jul 19 14:38:25  ag(ag_cluster)[46925]:    INFO: mssql_validate
>Jul 19 14:38:25  ag(ag_cluster)[46925]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:25  ag(ag_cluster)[46925]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:25  ag(ag_cluster)[46925]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:25  ag(ag_cluster)[46925]:    INFO: mssql_notify pre-demote
>Jul 19 14:38:25  ag(ag_cluster)[46925]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: mssql_validate
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: mssql_monitor
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:25 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:25 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server1]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:25 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:38:25  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:25 Connected to the instance at localhost:1433
>Jul 19 14:38:30  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:30 Monitor Caller is: monitor.
>Jul 19 14:38:30  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:30 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:38:30  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:30 Replica is SECONDARY (2)
>Jul 19 14:38:30  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:30 Instance name is server3.
>Jul 19 14:38:30  ag(ag_cluster)[46970]:    INFO: monitor: 2023/07/19 14:38:30 Current master is server1.
>Jul 19 14:38:31  ag(ag_cluster)[46970]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:38:31  ag(ag_cluster)[46970]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:38:31  ag(ag_cluster)[46970]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:38:31  ag(ag_cluster)[46970]:    INFO: ag_cluster monitor : 0
>Jul 19 14:38:31  ag(ag_cluster)[47124]:    INFO: mssql_validate
>Jul 19 14:38:31  ag(ag_cluster)[47124]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:31  ag(ag_cluster)[47124]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:31  ag(ag_cluster)[47124]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:31  ag(ag_cluster)[47124]:    INFO: mssql_notify post-demote
>Jul 19 14:38:31  ag(ag_cluster)[47124]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:31  ag(ag_cluster)[47169]:    INFO: mssql_validate
>Jul 19 14:38:31  ag(ag_cluster)[47169]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:31  ag(ag_cluster)[47169]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:31  ag(ag_cluster)[47169]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:31  ag(ag_cluster)[47169]:    INFO: mssql_notify pre-stop
>Jul 19 14:38:31  ag(ag_cluster)[47169]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: mssql_validate
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: mssql_notify post-stop
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: notify: 2023/07/19 14:38:31 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: notify: 2023/07/19 14:38:31 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: notify: 2023/07/19 14:38:31 Replica is SECONDARY (2)
>Jul 19 14:38:31  ag(ag_cluster)[47214]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: mssql_validate
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: mssql_notify pre-start
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: notify: 2023/07/19 14:38:31 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: notify: 2023/07/19 14:38:31 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: notify: 2023/07/19 14:38:31 Replica is SECONDARY (2)
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: notify: 2023/07/19 14:38:31 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: notify: 2023/07/19 14:38:31 Sequence number is 3847:F (61877593833487)
>Jul 19 14:38:31  ag(ag_cluster)[47289]:    INFO: notify: SEQUENCE_NUMBER: 61877593833487
>Jul 19 14:38:36  ag(ag_cluster)[47289]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:36  ag(ag_cluster)[47388]:    INFO: mssql_validate
>Jul 19 14:38:36  ag(ag_cluster)[47388]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:36  ag(ag_cluster)[47388]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:36  ag(ag_cluster)[47388]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:36  ag(ag_cluster)[47388]:    INFO: mssql_notify pre-stop
>Jul 19 14:38:36  ag(ag_cluster)[47388]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: mssql_validate
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: mssql_notify post-stop
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: notify: 2023/07/19 14:38:37 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: notify: 2023/07/19 14:38:37 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: notify: 2023/07/19 14:38:37 Replica is SECONDARY (2)
>Jul 19 14:38:37  ag(ag_cluster)[47434]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: mssql_validate
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: mssql_notify pre-start
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: notify: 2023/07/19 14:38:37 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: notify: 2023/07/19 14:38:37 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: notify: 2023/07/19 14:38:37 Replica is SECONDARY (2)
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: notify: 2023/07/19 14:38:37 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: notify: 2023/07/19 14:38:37 Sequence number is 3847:F (61877593833487)
>Jul 19 14:38:37  ag(ag_cluster)[47508]:    INFO: notify: SEQUENCE_NUMBER: 61877593833487
>Jul 19 14:38:42  ag(ag_cluster)[47508]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: mssql_validate
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: mssql_monitor
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:42 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:42 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:42 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:38:42  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:42 Connected to the instance at localhost:1433
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:47 Monitor Caller is: monitor.
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:47 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:47 Replica is SECONDARY (2)
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:47 Instance name is server3.
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: monitor: 2023/07/19 14:38:47 Current master is .
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:38:47  ag(ag_cluster)[47607]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:38:48  ag(ag_cluster)[47607]:    INFO: ag_cluster monitor : 0
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: mssql_validate
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: mssql_monitor
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:48 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:48 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server1]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:48 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:38:48  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:48 Connected to the instance at localhost:1433
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:53 Monitor Caller is: monitor.
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:53 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:53 Replica is SECONDARY (2)
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:53 Instance name is server3.
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: monitor: 2023/07/19 14:38:53 Current master is server1.
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:38:53  ag(ag_cluster)[47769]:    INFO: ag_cluster monitor : 0
>Jul 19 14:38:53  ag(ag_cluster)[47925]:    INFO: mssql_validate
>Jul 19 14:38:53  ag(ag_cluster)[47925]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:53  ag(ag_cluster)[47925]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:53  ag(ag_cluster)[47925]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:53  ag(ag_cluster)[47925]:    INFO: mssql_notify post-start
>Jul 19 14:38:53  ag(ag_cluster)[47925]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:53  ag(ag_cluster)[47971]:    INFO: mssql_validate
>Jul 19 14:38:53  ag(ag_cluster)[47971]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:53  ag(ag_cluster)[47971]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:53  ag(ag_cluster)[47971]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:53  ag(ag_cluster)[47971]:    INFO: mssql_notify pre-demote
>Jul 19 14:38:53  ag(ag_cluster)[47971]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:53  ag(ag_cluster)[48016]:    INFO: mssql_validate
>Jul 19 14:38:53  ag(ag_cluster)[48016]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:53  ag(ag_cluster)[48016]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:53  ag(ag_cluster)[48016]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:53  ag(ag_cluster)[48016]:    INFO: mssql_notify post-demote
>Jul 19 14:38:53  ag(ag_cluster)[48016]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:53  ag(ag_cluster)[48061]:    INFO: mssql_validate
>Jul 19 14:38:53  ag(ag_cluster)[48061]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:53  ag(ag_cluster)[48061]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:53  ag(ag_cluster)[48061]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:53  ag(ag_cluster)[48061]:    INFO: mssql_notify pre-stop
>Jul 19 14:38:53  ag(ag_cluster)[48061]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: mssql_validate
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: mssql_notify post-stop
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: notify: 2023/07/19 14:38:53 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: notify: 2023/07/19 14:38:53 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: notify: 2023/07/19 14:38:53 Replica is SECONDARY (2)
>Jul 19 14:38:53  ag(ag_cluster)[48106]:    INFO: ag_cluster notify : 0
>Jul 19 14:38:53  ag(ag_cluster)[48181]:    INFO: mssql_validate
>Jul 19 14:38:54  ag(ag_cluster)[48181]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:38:54  ag(ag_cluster)[48181]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:38:54  ag(ag_cluster)[48181]:    INFO: Resource agent invoked with: notify
>Jul 19 14:38:54  ag(ag_cluster)[48181]:    INFO: mssql_notify pre-promote
>Jul 19 14:38:54  ag(ag_cluster)[48181]:    INFO: notify: 2023/07/19 14:38:54 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:38:54  ag(ag_cluster)[48181]:    INFO: notify: 2023/07/19 14:38:54 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:38:54  ag(ag_cluster)[48181]:    INFO: notify: 2023/07/19 14:38:54 Connected to the instance at localhost:1433
>Jul 19 14:38:59  ag(ag_cluster)[48181]:    INFO: notify: 2023/07/19 14:38:59 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:38:59  ag(ag_cluster)[48181]:    INFO: notify: 2023/07/19 14:38:59 Sequence number is 3847:F (61877593833487)
>Jul 19 14:38:59  ag(ag_cluster)[48181]:    INFO: notify: SEQUENCE_NUMBER: 61877593833487
>Jul 19 14:39:04  ag(ag_cluster)[48181]:    INFO: ag_cluster notify : 0
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: mssql_validate
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: mssql_monitor
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:39:04  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:04 Connected to the instance at localhost:1433
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:09 Monitor Caller is: monitor.
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:09 Replica is SECONDARY (2)
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:09 Instance name is server3.
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: monitor: 2023/07/19 14:39:09 Current master is .
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:39:09  ag(ag_cluster)[48283]:    INFO: ag_cluster monitor : 0
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: mssql_validate
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: mssql_monitor
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:09 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master []; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:09 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:39:09  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:09 Connected to the instance at localhost:1433
>Jul 19 14:39:14  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:14 Monitor Caller is: monitor.
>Jul 19 14:39:14  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:14  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:14 Replica is SECONDARY (2)
>Jul 19 14:39:14  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:14 Instance name is server3.
>Jul 19 14:39:14  ag(ag_cluster)[48439]:    INFO: monitor: 2023/07/19 14:39:14 Current master is .
>Jul 19 14:39:14  ag(ag_cluster)[48439]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:39:15  ag(ag_cluster)[48439]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:39:15  ag(ag_cluster)[48439]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:39:15  ag(ag_cluster)[48439]:    INFO: ag_cluster monitor : 0
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: mssql_validate
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: Resource agent invoked with: notify
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: mssql_notify pre-promote
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: notify: 2023/07/19 14:39:15 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: notify: 2023/07/19 14:39:15 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:39:15  ag(ag_cluster)[48593]:    INFO: notify: 2023/07/19 14:39:15 Connected to the instance at localhost:1433
>Jul 19 14:39:20  ag(ag_cluster)[48593]:    INFO: notify: 2023/07/19 14:39:20 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:39:20  ag(ag_cluster)[48593]:    INFO: notify: 2023/07/19 14:39:20 Sequence number is 3847:F (61877593833487)
>Jul 19 14:39:20  ag(ag_cluster)[48593]:    INFO: notify: SEQUENCE_NUMBER: 61877593833487
>Jul 19 14:39:25  ag(ag_cluster)[48593]:    INFO: ag_cluster notify : 0
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: mssql_validate
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: mssql_monitor
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:25 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:25 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:25 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:39:25  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:25 Connected to the instance at localhost:1433
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:30 Monitor Caller is: monitor.
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:30 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:30 Replica is SECONDARY (2)
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:30 Instance name is server3.
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: monitor: 2023/07/19 14:39:30 Current master is server2.
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:39:30  ag(ag_cluster)[48697]:    INFO: ag_cluster monitor : 0
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: mssql_validate
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: mssql_monitor
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:30 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:30 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:30 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:39:30  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:30 Connected to the instance at localhost:1433
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:35 Monitor Caller is: monitor.
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:35 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:35 Replica is SECONDARY (2)
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:35 Instance name is server3.
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: monitor: 2023/07/19 14:39:35 Current master is server2.
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:39:35  ag(ag_cluster)[48850]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:39:36  ag(ag_cluster)[48850]:    INFO: ag_cluster monitor : 0
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: mssql_validate
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: Resource agent invoked with: notify
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: mssql_notify post-promote
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: notify: 2023/07/19 14:39:36 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: notify: 2023/07/19 14:39:36 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: notify: 2023/07/19 14:39:36 Replica is SECONDARY (2)
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: notify: 2023/07/19 14:39:36 Setting secondary to offline
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: notify: 2023/07/19 14:39:36 Offlining replica...
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: notify: 2023/07/19 14:39:36 Replica is RESOLVING (0)
>Jul 19 14:39:36  ag(ag_cluster)[49004]:    INFO: ag_cluster notify : 0
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: mssql_validate
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: mssql_monitor
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:42 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:42 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:42 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:39:42  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:42 Connected to the instance at localhost:1433
>Jul 19 14:39:47  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 Monitor Caller is: monitor.
>Jul 19 14:39:47  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:48  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 Replica is RESOLVING (0)
>Jul 19 14:39:48  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 Instance name is server3.
>Jul 19 14:39:48  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 Current master is server2.
>Jul 19 14:39:48  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 Setting the role to Secondary.
>Jul 19 14:39:48  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 Setting replica to SECONDARY role...
>Jul 19 14:39:48  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:47 Replica is RESOLVING (0)
>Jul 19 14:39:48  ag(ag_cluster)[49100]:    INFO: monitor: 2023/07/19 14:39:48 Replica is SECONDARY (2)
>Jul 19 14:39:49  ag(ag_cluster)[49100]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:39:49  ag(ag_cluster)[49100]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:39:49  ag(ag_cluster)[49100]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:39:49  ag(ag_cluster)[49100]:    INFO: ag_cluster monitor : 0
>Jul 19 14:39:49  ag(ag_cluster)[49285]:    INFO: mssql_validate
>Jul 19 14:39:49  ag(ag_cluster)[49285]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:39:49  ag(ag_cluster)[49285]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:49  ag(ag_cluster)[49285]:    INFO: Resource agent invoked with: notify
>Jul 19 14:39:49  ag(ag_cluster)[49285]:    INFO: mssql_notify pre-stop
>Jul 19 14:39:49  ag(ag_cluster)[49285]:    INFO: ag_cluster notify : 0
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: mssql_validate
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: mssql_monitor
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:49 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:49 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:49 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:39:49  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:49 Connected to the instance at localhost:1433
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:54 Monitor Caller is: monitor.
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:54 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:54 Replica is SECONDARY (2)
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:54 Instance name is server3.
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: monitor: 2023/07/19 14:39:54 Current master is server2.
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:39:54  ag(ag_cluster)[49331]:    INFO: ag_cluster monitor : 0
>Jul 19 14:39:54  ag(ag_cluster)[49486]:    INFO: mssql_validate
>Jul 19 14:39:54  ag(ag_cluster)[49486]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:39:54  ag(ag_cluster)[49486]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:54  ag(ag_cluster)[49486]:    INFO: Resource agent invoked with: notify
>Jul 19 14:39:54  ag(ag_cluster)[49486]:    INFO: mssql_notify pre-stop
>Jul 19 14:39:54  ag(ag_cluster)[49486]:    INFO: ag_cluster notify : 0
>Jul 19 14:39:55  ag(ag_cluster)[49531]:    INFO: mssql_validate
>Jul 19 14:39:55  ag(ag_cluster)[49531]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:39:55  ag(ag_cluster)[49531]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:39:55  ag(ag_cluster)[49531]:    INFO: Resource agent invoked with: notify
>Jul 19 14:39:55  ag(ag_cluster)[49531]:    INFO: mssql_notify pre-stop
>Jul 19 14:39:55  ag(ag_cluster)[49531]:    INFO: ag_cluster notify : 0
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: mssql_validate
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: Resource agent invoked with: stop
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: mssql_stop
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: stop: 2023/07/19 14:39:58 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: stop: 2023/07/19 14:39:58 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: stop: 2023/07/19 14:39:58 Replica is SECONDARY (2)
>Jul 19 14:39:58  ag(ag_cluster)[49576]:    INFO: ag_cluster stop : 0
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: mssql_validate
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: Resource agent invoked with: start
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: mssql_start
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:09 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:09 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:09 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:40:09  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:09 Connected to the instance at localhost:1433
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Replica is SECONDARY (2)
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Sequence number is 3848:B (61881888800779)
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Line does not match expected syntax. Ignoring.
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Line does not match expected syntax. Ignoring.
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61881888800779"]
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 1 sequence numbers were found
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Max sequence number is 3848:B (61881888800779)
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Monitor Caller is: start.
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Replica is SECONDARY (2)
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Instance name is server3.
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: 2023/07/19 14:40:14 Current master is server2.
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:40:14  ag(ag_cluster)[49658]:    INFO: ag_cluster start : 0
>Jul 19 14:40:15  ag(ag_cluster)[49855]:    INFO: mssql_validate
>Jul 19 14:40:15  ag(ag_cluster)[49855]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:40:15  ag(ag_cluster)[49855]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:15  ag(ag_cluster)[49855]:    INFO: Resource agent invoked with: notify
>Jul 19 14:40:15  ag(ag_cluster)[49855]:    INFO: mssql_notify post-start
>Jul 19 14:40:15  ag(ag_cluster)[49855]:    INFO: ag_cluster notify : 0
>Jul 19 14:40:15  ag(ag_cluster)[49901]:    INFO: mssql_validate
>Jul 19 14:40:15  ag(ag_cluster)[49901]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:40:15  ag(ag_cluster)[49901]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:15  ag(ag_cluster)[49901]:    INFO: Resource agent invoked with: notify
>Jul 19 14:40:15  ag(ag_cluster)[49901]:    INFO: mssql_notify pre-demote
>Jul 19 14:40:15  ag(ag_cluster)[49901]:    INFO: ag_cluster notify : 0
>Jul 19 14:40:15  ag(ag_cluster)[49946]:    INFO: mssql_validate
>Jul 19 14:40:15  ag(ag_cluster)[49946]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:40:15  ag(ag_cluster)[49946]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:15  ag(ag_cluster)[49946]:    INFO: Resource agent invoked with: notify
>Jul 19 14:40:15  ag(ag_cluster)[49946]:    INFO: mssql_notify post-demote
>Jul 19 14:40:15  ag(ag_cluster)[49946]:    INFO: ag_cluster notify : 0
>Jul 19 14:40:15  ag(ag_cluster)[49991]:    INFO: mssql_validate
>Jul 19 14:40:15  ag(ag_cluster)[49991]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:40:15  ag(ag_cluster)[49991]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:15  ag(ag_cluster)[49991]:    INFO: Resource agent invoked with: notify
>Jul 19 14:40:15  ag(ag_cluster)[49991]:    INFO: mssql_notify pre-stop
>Jul 19 14:40:15  ag(ag_cluster)[49991]:    INFO: ag_cluster notify : 0
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: mssql_validate
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: Resource agent invoked with: notify
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: mssql_notify post-stop
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: notify: 2023/07/19 14:40:15 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: notify: 2023/07/19 14:40:15 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: notify: 2023/07/19 14:40:15 Replica is SECONDARY (2)
>Jul 19 14:40:15  ag(ag_cluster)[50036]:    INFO: ag_cluster notify : 0
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: mssql_validate
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: mssql_monitor
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:15 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:15 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:15 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:40:15  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:15 Connected to the instance at localhost:1433
>Jul 19 14:40:20  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:20 Monitor Caller is: monitor.
>Jul 19 14:40:20  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:20 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:40:20  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:20 Replica is SECONDARY (2)
>Jul 19 14:40:20  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:20 Instance name is server3.
>Jul 19 14:40:20  ag(ag_cluster)[50110]:    INFO: monitor: 2023/07/19 14:40:20 Current master is server2.
>Jul 19 14:40:20  ag(ag_cluster)[50110]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:40:21  ag(ag_cluster)[50110]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:40:21  ag(ag_cluster)[50110]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:40:21  ag(ag_cluster)[50110]:    INFO: ag_cluster monitor : 0
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: mssql_validate
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: mssql_monitor
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:40:21  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:21 Connected to the instance at localhost:1433
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:26 Monitor Caller is: monitor.
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:26 Replica is SECONDARY (2)
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:26 Instance name is server3.
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: monitor: 2023/07/19 14:40:26 Current master is server2.
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:40:26  ag(ag_cluster)[50265]:    INFO: ag_cluster monitor : 0
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: mssql_validate
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: mssql_monitor
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:33 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:33 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:33 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:40:33  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:33 Connected to the instance at localhost:1433
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:38 Monitor Caller is: monitor.
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:38 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:38 Replica is SECONDARY (2)
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:38 Instance name is server3.
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: monitor: 2023/07/19 14:40:38 Current master is server2.
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:40:38  ag(ag_cluster)[50420]:    INFO: ag_cluster monitor : 0
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: mssql_validate
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: mssql_monitor
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:38 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:40:38  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:38 Connected to the instance at localhost:1433
>Jul 19 14:40:43  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:43 Monitor Caller is: monitor.
>Jul 19 14:40:43  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:43 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:40:43  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:43 Replica is SECONDARY (2)
>Jul 19 14:40:43  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:43 Instance name is server3.
>Jul 19 14:40:43  ag(ag_cluster)[50574]:    INFO: monitor: 2023/07/19 14:40:43 Current master is server2.
>Jul 19 14:40:43  ag(ag_cluster)[50574]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:40:44  ag(ag_cluster)[50574]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:40:44  ag(ag_cluster)[50574]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:40:44  ag(ag_cluster)[50574]:    INFO: ag_cluster monitor : 0
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: mssql_validate
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: mssql_monitor
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:50 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:50 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:50 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:40:50  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:50 Connected to the instance at localhost:1433
>Jul 19 14:40:55  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:55 Monitor Caller is: monitor.
>Jul 19 14:40:55  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:55 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:40:55  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:55 Replica is SECONDARY (2)
>Jul 19 14:40:55  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:55 Instance name is server3.
>Jul 19 14:40:55  ag(ag_cluster)[50736]:    INFO: monitor: 2023/07/19 14:40:55 Current master is server2.
>Jul 19 14:40:55  ag(ag_cluster)[50736]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:40:56  ag(ag_cluster)[50736]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:40:56  ag(ag_cluster)[50736]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:40:56  ag(ag_cluster)[50736]:    INFO: ag_cluster monitor : 0
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: mssql_validate
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: mssql_monitor
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:40:56 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:40:56 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:40:56 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:40:56  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:40:56 Connected to the instance at localhost:1433
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:41:01 Monitor Caller is: monitor.
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:41:01 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:41:01 Replica is SECONDARY (2)
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:41:01 Instance name is server3.
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: monitor: 2023/07/19 14:41:01 Current master is server2.
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:41:01  ag(ag_cluster)[50893]:    INFO: ag_cluster monitor : 0
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: mssql_validate
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: mssql_monitor
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:08 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:08 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:08 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:41:08  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:08 Connected to the instance at localhost:1433
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:13 Monitor Caller is: monitor.
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:13 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:13 Replica is SECONDARY (2)
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:13 Instance name is server3.
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: monitor: 2023/07/19 14:41:13 Current master is server2.
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:41:13  ag(ag_cluster)[51048]:    INFO: ag_cluster monitor : 0
>Jul 19 14:41:13  ag(ag_cluster)[51201]:    INFO: mssql_validate
>Jul 19 14:41:13  ag(ag_cluster)[51201]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:13  ag(ag_cluster)[51201]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:13  ag(ag_cluster)[51201]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:13  ag(ag_cluster)[51201]:    INFO: mssql_notify pre-stop
>Jul 19 14:41:13  ag(ag_cluster)[51201]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: mssql_validate
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: mssql_monitor
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:13 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:13 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:13 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:41:13  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:13 Connected to the instance at localhost:1433
>Jul 19 14:41:18  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:18 Monitor Caller is: monitor.
>Jul 19 14:41:18  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:18 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:41:18  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:18 Replica is SECONDARY (2)
>Jul 19 14:41:18  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:18 Instance name is server3.
>Jul 19 14:41:18  ag(ag_cluster)[51246]:    INFO: monitor: 2023/07/19 14:41:18 Current master is server2.
>Jul 19 14:41:18  ag(ag_cluster)[51246]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:41:19  ag(ag_cluster)[51246]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:41:19  ag(ag_cluster)[51246]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:41:19  ag(ag_cluster)[51246]:    INFO: ag_cluster monitor : 0
>Jul 19 14:41:19  ag(ag_cluster)[51399]:    INFO: mssql_validate
>Jul 19 14:41:19  ag(ag_cluster)[51399]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:19  ag(ag_cluster)[51399]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:19  ag(ag_cluster)[51399]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:19  ag(ag_cluster)[51399]:    INFO: mssql_notify pre-stop
>Jul 19 14:41:19  ag(ag_cluster)[51399]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: mssql_validate
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: Resource agent invoked with: stop
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: mssql_stop
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: stop: 2023/07/19 14:41:19 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: stop: 2023/07/19 14:41:19 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: stop: 2023/07/19 14:41:19 Replica is SECONDARY (2)
>Jul 19 14:41:19  ag(ag_cluster)[51445]:    INFO: ag_cluster stop : 0
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: mssql_validate
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: Resource agent invoked with: start
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: mssql_start
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:31 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:31 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:31 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:41:31  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:31 Connected to the instance at localhost:1433
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Replica is SECONDARY (2)
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Sequence number is 3848:B (61881888800779)
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Line does not match expected syntax. Ignoring.
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Line does not match expected syntax. Ignoring.
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61881888800779"]
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 1 sequence numbers were found
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Max sequence number is 3848:B (61881888800779)
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Monitor Caller is: start.
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Replica is SECONDARY (2)
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Instance name is server3.
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: 2023/07/19 14:41:36 Current master is server2.
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:41:36  ag(ag_cluster)[51527]:    INFO: ag_cluster start : 0
>Jul 19 14:41:36  ag(ag_cluster)[51724]:    INFO: mssql_validate
>Jul 19 14:41:36  ag(ag_cluster)[51724]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:36  ag(ag_cluster)[51724]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:36  ag(ag_cluster)[51724]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:36  ag(ag_cluster)[51724]:    INFO: mssql_notify post-start
>Jul 19 14:41:36  ag(ag_cluster)[51724]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:37  ag(ag_cluster)[51771]:    INFO: mssql_validate
>Jul 19 14:41:37  ag(ag_cluster)[51771]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:37  ag(ag_cluster)[51771]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:37  ag(ag_cluster)[51771]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:37  ag(ag_cluster)[51771]:    INFO: mssql_notify pre-demote
>Jul 19 14:41:37  ag(ag_cluster)[51771]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:37  ag(ag_cluster)[51816]:    INFO: mssql_validate
>Jul 19 14:41:37  ag(ag_cluster)[51816]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:37  ag(ag_cluster)[51816]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:37  ag(ag_cluster)[51816]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:37  ag(ag_cluster)[51816]:    INFO: mssql_notify post-demote
>Jul 19 14:41:37  ag(ag_cluster)[51816]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:37  ag(ag_cluster)[51861]:    INFO: mssql_validate
>Jul 19 14:41:37  ag(ag_cluster)[51861]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:37  ag(ag_cluster)[51861]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:38  ag(ag_cluster)[51861]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:38  ag(ag_cluster)[51861]:    INFO: mssql_notify pre-stop
>Jul 19 14:41:38  ag(ag_cluster)[51861]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: mssql_validate
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: mssql_notify post-stop
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: notify: 2023/07/19 14:41:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: notify: 2023/07/19 14:41:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: notify: 2023/07/19 14:41:38 Replica is SECONDARY (2)
>Jul 19 14:41:38  ag(ag_cluster)[51906]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: mssql_validate
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: mssql_notify pre-start
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: notify: 2023/07/19 14:41:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: notify: 2023/07/19 14:41:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: notify: 2023/07/19 14:41:38 Replica is SECONDARY (2)
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: notify: 2023/07/19 14:41:38 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: notify: 2023/07/19 14:41:38 Sequence number is 3848:B (61881888800779)
>Jul 19 14:41:38  ag(ag_cluster)[51980]:    INFO: notify: SEQUENCE_NUMBER: 61881888800779
>Jul 19 14:41:43  ag(ag_cluster)[51980]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: mssql_validate
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: mssql_notify pre-start
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: notify: 2023/07/19 14:41:43 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: notify: 2023/07/19 14:41:43 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: notify: 2023/07/19 14:41:43 Replica is SECONDARY (2)
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: notify: 2023/07/19 14:41:43 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: notify: 2023/07/19 14:41:43 Sequence number is 3848:B (61881888800779)
>Jul 19 14:41:43  ag(ag_cluster)[52080]:    INFO: notify: SEQUENCE_NUMBER: 61881888800779
>Jul 19 14:41:48  ag(ag_cluster)[52080]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:54  ag(ag_cluster)[52189]:    INFO: mssql_validate
>Jul 19 14:41:54  ag(ag_cluster)[52189]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:54  ag(ag_cluster)[52189]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:54  ag(ag_cluster)[52189]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:54  ag(ag_cluster)[52189]:    INFO: mssql_notify post-start
>Jul 19 14:41:54  ag(ag_cluster)[52189]:    INFO: ag_cluster notify : 0
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: mssql_validate
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: Resource agent invoked with: notify
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: mssql_notify pre-promote
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: notify: 2023/07/19 14:41:54 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: notify: 2023/07/19 14:41:54 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:41:54  ag(ag_cluster)[52235]:    INFO: notify: 2023/07/19 14:41:54 Connected to the instance at localhost:1433
>Jul 19 14:41:59  ag(ag_cluster)[52235]:    INFO: notify: 2023/07/19 14:41:59 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:41:59  ag(ag_cluster)[52235]:    INFO: notify: 2023/07/19 14:41:59 Sequence number is 3848:B (61881888800779)
>Jul 19 14:41:59  ag(ag_cluster)[52235]:    INFO: notify: SEQUENCE_NUMBER: 61881888800779
>Jul 19 14:42:04  ag(ag_cluster)[52235]:    INFO: ag_cluster notify : 0
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: mssql_validate
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: Resource agent invoked with: notify
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: mssql_notify pre-promote
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: notify: 2023/07/19 14:42:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: notify: 2023/07/19 14:42:04 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:42:04  ag(ag_cluster)[52338]:    INFO: notify: 2023/07/19 14:42:04 Connected to the instance at localhost:1433
>Jul 19 14:42:09  ag(ag_cluster)[52338]:    INFO: notify: 2023/07/19 14:42:09 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:42:09  ag(ag_cluster)[52338]:    INFO: notify: 2023/07/19 14:42:09 Sequence number is 3848:B (61881888800779)
>Jul 19 14:42:09  ag(ag_cluster)[52338]:    INFO: notify: SEQUENCE_NUMBER: 61881888800779
>Jul 19 14:42:14  ag(ag_cluster)[52338]:    INFO: ag_cluster notify : 0
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: mssql_validate
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: Resource agent invoked with: notify
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: mssql_notify post-promote
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: notify: 2023/07/19 14:42:20 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: notify: 2023/07/19 14:42:20 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: notify: 2023/07/19 14:42:20 Replica is SECONDARY (2)
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: notify: 2023/07/19 14:42:20 Setting secondary to offline
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: notify: 2023/07/19 14:42:20 Offlining replica...
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: notify: 2023/07/19 14:42:20 Replica is RESOLVING (0)
>Jul 19 14:42:20  ag(ag_cluster)[52443]:    INFO: ag_cluster notify : 0
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: mssql_validate
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: mssql_monitor
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:20 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:20 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:20 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:42:20  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:20 Connected to the instance at localhost:1433
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 Monitor Caller is: monitor.
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 Replica is RESOLVING (0)
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 Instance name is server3.
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 Current master is server2.
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 Setting the role to Secondary.
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 Setting replica to SECONDARY role...
>Jul 19 14:42:25  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:25 Replica is RESOLVING (0)
>Jul 19 14:42:26  ag(ag_cluster)[52537]:    INFO: monitor: 2023/07/19 14:42:26 Replica is SECONDARY (2)
>Jul 19 14:42:26  ag(ag_cluster)[52537]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:42:27  ag(ag_cluster)[52537]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:42:27  ag(ag_cluster)[52537]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:42:27  ag(ag_cluster)[52537]:    INFO: ag_cluster monitor : 0
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: mssql_validate
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: mssql_monitor
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:27 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:27 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:27 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:42:27  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:27 Connected to the instance at localhost:1433
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:32 Monitor Caller is: monitor.
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:32 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:32 Replica is SECONDARY (2)
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:32 Instance name is server3.
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: monitor: 2023/07/19 14:42:32 Current master is server2.
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:42:32  ag(ag_cluster)[52716]:    INFO: ag_cluster monitor : 0
>Jul 19 14:42:32  ag(ag_cluster)[52870]:    INFO: mssql_validate
>Jul 19 14:42:32  ag(ag_cluster)[52870]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:42:32  ag(ag_cluster)[52870]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:42:32  ag(ag_cluster)[52870]:    INFO: Resource agent invoked with: notify
>Jul 19 14:42:32  ag(ag_cluster)[52870]:    INFO: mssql_notify pre-stop
>Jul 19 14:42:32  ag(ag_cluster)[52870]:    INFO: ag_cluster notify : 0
>Jul 19 14:42:32  ag(ag_cluster)[52915]:    INFO: mssql_validate
>Jul 19 14:42:32  ag(ag_cluster)[52915]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:42:32  ag(ag_cluster)[52915]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:42:32  ag(ag_cluster)[52915]:    INFO: Resource agent invoked with: notify
>Jul 19 14:42:32  ag(ag_cluster)[52915]:    INFO: mssql_notify pre-stop
>Jul 19 14:42:32  ag(ag_cluster)[52915]:    INFO: ag_cluster notify : 0
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: mssql_validate
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: Resource agent invoked with: stop
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: mssql_stop
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: stop: 2023/07/19 14:42:32 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: stop: 2023/07/19 14:42:32 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: stop: 2023/07/19 14:42:32 Replica is SECONDARY (2)
>Jul 19 14:42:32  ag(ag_cluster)[52960]:    INFO: ag_cluster stop : 0
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: mssql_validate
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: Resource agent invoked with: start
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: mssql_start
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:54 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:54 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:54 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:42:54  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:54 Connected to the instance at localhost:1433
>Jul 19 14:42:59  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:42:59  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Replica is SECONDARY (2)
>Jul 19 14:42:59  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Sequence number is 3849:B (61886183768075)
>Jul 19 14:42:59  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:42:59  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:42:59  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Line does not match expected syntax. Ignoring.
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Line does not match expected syntax. Ignoring.
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61886183768075"]
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 1 sequence numbers were found
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Max sequence number is 3849:B (61886183768075)
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Monitor Caller is: start.
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Replica is SECONDARY (2)
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Instance name is server3.
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: 2023/07/19 14:42:59 Current master is server2.
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:43:00  ag(ag_cluster)[53052]:    INFO: ag_cluster start : 0
>Jul 19 14:43:00  ag(ag_cluster)[53249]:    INFO: mssql_validate
>Jul 19 14:43:00  ag(ag_cluster)[53249]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:00  ag(ag_cluster)[53249]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:00  ag(ag_cluster)[53249]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:00  ag(ag_cluster)[53249]:    INFO: mssql_notify post-start
>Jul 19 14:43:00  ag(ag_cluster)[53249]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:00  ag(ag_cluster)[53295]:    INFO: mssql_validate
>Jul 19 14:43:00  ag(ag_cluster)[53295]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:00  ag(ag_cluster)[53295]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:00  ag(ag_cluster)[53295]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:00  ag(ag_cluster)[53295]:    INFO: mssql_notify pre-demote
>Jul 19 14:43:00  ag(ag_cluster)[53295]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:01  ag(ag_cluster)[53340]:    INFO: mssql_validate
>Jul 19 14:43:01  ag(ag_cluster)[53340]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:01  ag(ag_cluster)[53340]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:01  ag(ag_cluster)[53340]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:01  ag(ag_cluster)[53340]:    INFO: mssql_notify post-demote
>Jul 19 14:43:01  ag(ag_cluster)[53340]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:01  ag(ag_cluster)[53385]:    INFO: mssql_validate
>Jul 19 14:43:01  ag(ag_cluster)[53385]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:01  ag(ag_cluster)[53385]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:01  ag(ag_cluster)[53385]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:01  ag(ag_cluster)[53385]:    INFO: mssql_notify pre-stop
>Jul 19 14:43:01  ag(ag_cluster)[53385]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: mssql_validate
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: mssql_notify post-stop
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: notify: 2023/07/19 14:43:01 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: notify: 2023/07/19 14:43:01 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: notify: 2023/07/19 14:43:01 Replica is SECONDARY (2)
>Jul 19 14:43:01  ag(ag_cluster)[53430]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: mssql_validate
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: mssql_notify pre-start
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: notify: 2023/07/19 14:43:01 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: notify: 2023/07/19 14:43:01 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: notify: 2023/07/19 14:43:01 Replica is SECONDARY (2)
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: notify: 2023/07/19 14:43:01 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: notify: 2023/07/19 14:43:01 Sequence number is 3849:B (61886183768075)
>Jul 19 14:43:01  ag(ag_cluster)[53504]:    INFO: notify: SEQUENCE_NUMBER: 61886183768075
>Jul 19 14:43:06  ag(ag_cluster)[53504]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: mssql_validate
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: mssql_notify pre-start
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: notify: 2023/07/19 14:43:07 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: notify: 2023/07/19 14:43:07 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: notify: 2023/07/19 14:43:07 Replica is SECONDARY (2)
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: notify: 2023/07/19 14:43:07 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: notify: 2023/07/19 14:43:07 Sequence number is 3849:B (61886183768075)
>Jul 19 14:43:07  ag(ag_cluster)[53604]:    INFO: notify: SEQUENCE_NUMBER: 61886183768075
>Jul 19 14:43:12  ag(ag_cluster)[53604]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:17  ag(ag_cluster)[53704]:    INFO: mssql_validate
>Jul 19 14:43:17  ag(ag_cluster)[53704]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:17  ag(ag_cluster)[53704]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:17  ag(ag_cluster)[53704]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:17  ag(ag_cluster)[53704]:    INFO: mssql_notify post-start
>Jul 19 14:43:17  ag(ag_cluster)[53704]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: mssql_validate
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: mssql_notify pre-promote
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: notify: 2023/07/19 14:43:17 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: notify: 2023/07/19 14:43:17 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:43:17  ag(ag_cluster)[53750]:    INFO: notify: 2023/07/19 14:43:17 Connected to the instance at localhost:1433
>Jul 19 14:43:22  ag(ag_cluster)[53750]:    INFO: notify: 2023/07/19 14:43:22 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:43:22  ag(ag_cluster)[53750]:    INFO: notify: 2023/07/19 14:43:22 Sequence number is 3849:B (61886183768075)
>Jul 19 14:43:22  ag(ag_cluster)[53750]:    INFO: notify: SEQUENCE_NUMBER: 61886183768075
>Jul 19 14:43:27  ag(ag_cluster)[53750]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: mssql_validate
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: mssql_notify pre-promote
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: notify: 2023/07/19 14:43:28 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: notify: 2023/07/19 14:43:28 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:43:28  ag(ag_cluster)[53854]:    INFO: notify: 2023/07/19 14:43:28 Connected to the instance at localhost:1433
>Jul 19 14:43:33  ag(ag_cluster)[53854]:    INFO: notify: 2023/07/19 14:43:33 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:43:33  ag(ag_cluster)[53854]:    INFO: notify: 2023/07/19 14:43:33 Sequence number is 3849:B (61886183768075)
>Jul 19 14:43:33  ag(ag_cluster)[53854]:    INFO: notify: SEQUENCE_NUMBER: 61886183768075
>Jul 19 14:43:38  ag(ag_cluster)[53854]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:43  ag(ag_cluster)[53960]:    INFO: mssql_validate
>Jul 19 14:43:43  ag(ag_cluster)[53960]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:43  ag(ag_cluster)[53960]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:43  ag(ag_cluster)[53960]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:43  ag(ag_cluster)[53960]:    INFO: mssql_notify post-promote
>Jul 19 14:43:44  ag(ag_cluster)[53960]:    INFO: notify: 2023/07/19 14:43:44 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:43:44  ag(ag_cluster)[53960]:    INFO: notify: 2023/07/19 14:43:44 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:43:44  ag(ag_cluster)[53960]:    INFO: notify: 2023/07/19 14:43:44 Replica is SECONDARY (2)
>Jul 19 14:43:44  ag(ag_cluster)[53960]:    INFO: notify: 2023/07/19 14:43:44 Setting secondary to offline
>Jul 19 14:43:44  ag(ag_cluster)[53960]:    INFO: notify: 2023/07/19 14:43:44 Offlining replica...
>Jul 19 14:43:44  ag(ag_cluster)[53960]:    INFO: notify: 2023/07/19 14:43:44 Replica is RESOLVING (0)
>Jul 19 14:43:44  ag(ag_cluster)[53960]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: mssql_validate
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: mssql_monitor
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:44 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:44 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:44 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:43:44  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:44 Connected to the instance at localhost:1433
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 Monitor Caller is: monitor.
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 Replica is RESOLVING (0)
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 Instance name is server3.
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 Current master is server2.
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 Setting the role to Secondary.
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 Setting replica to SECONDARY role...
>Jul 19 14:43:49  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:49 Replica is RESOLVING (0)
>Jul 19 14:43:50  ag(ag_cluster)[54054]:    INFO: monitor: 2023/07/19 14:43:50 Replica is SECONDARY (2)
>Jul 19 14:43:50  ag(ag_cluster)[54054]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:43:50  ag(ag_cluster)[54054]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:43:50  ag(ag_cluster)[54054]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:43:50  ag(ag_cluster)[54054]:    INFO: ag_cluster monitor : 0
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: mssql_validate
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: mssql_monitor
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:50 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:50 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:50 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:43:50  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:50 Connected to the instance at localhost:1433
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:55 Monitor Caller is: monitor.
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:55 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:55 Replica is SECONDARY (2)
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:55 Instance name is server3.
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: monitor: 2023/07/19 14:43:55 Current master is server2.
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:43:55  ag(ag_cluster)[54241]:    INFO: ag_cluster monitor : 0
>Jul 19 14:43:55  ag(ag_cluster)[54396]:    INFO: mssql_validate
>Jul 19 14:43:55  ag(ag_cluster)[54396]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:55  ag(ag_cluster)[54396]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:55  ag(ag_cluster)[54396]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:55  ag(ag_cluster)[54396]:    INFO: mssql_notify pre-stop
>Jul 19 14:43:55  ag(ag_cluster)[54396]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:55  ag(ag_cluster)[54441]:    INFO: mssql_validate
>Jul 19 14:43:55  ag(ag_cluster)[54441]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:55  ag(ag_cluster)[54441]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:43:55  ag(ag_cluster)[54441]:    INFO: Resource agent invoked with: notify
>Jul 19 14:43:55  ag(ag_cluster)[54441]:    INFO: mssql_notify pre-stop
>Jul 19 14:43:55  ag(ag_cluster)[54441]:    INFO: ag_cluster notify : 0
>Jul 19 14:43:55  ag(ag_cluster)[54486]:    INFO: mssql_validate
>Jul 19 14:43:55  ag(ag_cluster)[54486]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:43:55  ag(ag_cluster)[54486]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:43:55  ag(ag_cluster)[54486]:    INFO: Resource agent invoked with: stop
>Jul 19 14:43:55  ag(ag_cluster)[54486]:    INFO: mssql_stop
>Jul 19 14:43:56  ag(ag_cluster)[54486]:    INFO: stop: 2023/07/19 14:43:56 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:43:56  ag(ag_cluster)[54486]:    INFO: stop: 2023/07/19 14:43:56 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:43:56  ag(ag_cluster)[54486]:    INFO: stop: 2023/07/19 14:43:56 Replica is SECONDARY (2)
>Jul 19 14:43:56  ag(ag_cluster)[54486]:    INFO: ag_cluster stop : 0
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: mssql_validate
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: Resource agent invoked with: start
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: mssql_start
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:18 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:18 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:18 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:44:18  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:18 Connected to the instance at localhost:1433
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Replica is SECONDARY (2)
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Sequence number is 384A:B (61890478735371)
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Line does not match expected syntax. Ignoring.
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Line does not match expected syntax. Ignoring.
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61890478735371"]
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 1 sequence numbers were found
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Max sequence number is 384A:B (61890478735371)
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Monitor Caller is: start.
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Replica is SECONDARY (2)
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Instance name is server3.
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: 2023/07/19 14:44:23 Current master is server2.
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:44:23  ag(ag_cluster)[54570]:    INFO: ag_cluster start : 0
>Jul 19 14:44:23  ag(ag_cluster)[54769]:    INFO: mssql_validate
>Jul 19 14:44:23  ag(ag_cluster)[54769]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:23  ag(ag_cluster)[54769]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:23  ag(ag_cluster)[54769]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:23  ag(ag_cluster)[54769]:    INFO: mssql_notify post-start
>Jul 19 14:44:23  ag(ag_cluster)[54769]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:23  ag(ag_cluster)[54815]:    INFO: mssql_validate
>Jul 19 14:44:23  ag(ag_cluster)[54815]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:23  ag(ag_cluster)[54815]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:23  ag(ag_cluster)[54815]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:23  ag(ag_cluster)[54815]:    INFO: mssql_notify pre-demote
>Jul 19 14:44:23  ag(ag_cluster)[54815]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:23  ag(ag_cluster)[54860]:    INFO: mssql_validate
>Jul 19 14:44:23  ag(ag_cluster)[54860]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:23  ag(ag_cluster)[54860]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:23  ag(ag_cluster)[54860]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:23  ag(ag_cluster)[54860]:    INFO: mssql_notify post-demote
>Jul 19 14:44:23  ag(ag_cluster)[54860]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:23  ag(ag_cluster)[54905]:    INFO: mssql_validate
>Jul 19 14:44:23  ag(ag_cluster)[54905]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:23  ag(ag_cluster)[54905]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:24  ag(ag_cluster)[54905]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:24  ag(ag_cluster)[54905]:    INFO: mssql_notify pre-stop
>Jul 19 14:44:24  ag(ag_cluster)[54905]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: mssql_validate
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: mssql_notify post-stop
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: notify: 2023/07/19 14:44:24 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: notify: 2023/07/19 14:44:24 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: notify: 2023/07/19 14:44:24 Replica is SECONDARY (2)
>Jul 19 14:44:24  ag(ag_cluster)[54950]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: mssql_validate
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: mssql_notify pre-start
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: notify: 2023/07/19 14:44:24 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: notify: 2023/07/19 14:44:24 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: notify: 2023/07/19 14:44:24 Replica is SECONDARY (2)
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: notify: 2023/07/19 14:44:24 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: notify: 2023/07/19 14:44:24 Sequence number is 384A:B (61890478735371)
>Jul 19 14:44:24  ag(ag_cluster)[55024]:    INFO: notify: SEQUENCE_NUMBER: 61890478735371
>Jul 19 14:44:29  ag(ag_cluster)[55024]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: mssql_validate
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: mssql_notify pre-start
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: notify: 2023/07/19 14:44:29 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: notify: 2023/07/19 14:44:29 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: notify: 2023/07/19 14:44:29 Replica is SECONDARY (2)
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: notify: 2023/07/19 14:44:29 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: notify: 2023/07/19 14:44:29 Sequence number is 384A:B (61890478735371)
>Jul 19 14:44:29  ag(ag_cluster)[55123]:    INFO: notify: SEQUENCE_NUMBER: 61890478735371
>Jul 19 14:44:34  ag(ag_cluster)[55123]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:40  ag(ag_cluster)[55224]:    INFO: mssql_validate
>Jul 19 14:44:40  ag(ag_cluster)[55224]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:40  ag(ag_cluster)[55224]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:40  ag(ag_cluster)[55224]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:40  ag(ag_cluster)[55224]:    INFO: mssql_notify post-start
>Jul 19 14:44:40  ag(ag_cluster)[55224]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: mssql_validate
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: mssql_notify pre-promote
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: notify: 2023/07/19 14:44:40 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: notify: 2023/07/19 14:44:40 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:44:40  ag(ag_cluster)[55270]:    INFO: notify: 2023/07/19 14:44:40 Connected to the instance at localhost:1433
>Jul 19 14:44:45  ag(ag_cluster)[55270]:    INFO: notify: 2023/07/19 14:44:45 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:44:45  ag(ag_cluster)[55270]:    INFO: notify: 2023/07/19 14:44:45 Sequence number is 384A:B (61890478735371)
>Jul 19 14:44:45  ag(ag_cluster)[55270]:    INFO: notify: SEQUENCE_NUMBER: 61890478735371
>Jul 19 14:44:50  ag(ag_cluster)[55270]:    INFO: ag_cluster notify : 0
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: mssql_validate
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: Resource agent invoked with: notify
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: mssql_notify pre-promote
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: notify: 2023/07/19 14:44:51 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: notify: 2023/07/19 14:44:51 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:44:51  ag(ag_cluster)[55382]:    INFO: notify: 2023/07/19 14:44:51 Connected to the instance at localhost:1433
>Jul 19 14:44:56  ag(ag_cluster)[55382]:    INFO: notify: 2023/07/19 14:44:56 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:44:56  ag(ag_cluster)[55382]:    INFO: notify: 2023/07/19 14:44:56 Sequence number is 384A:B (61890478735371)
>Jul 19 14:44:56  ag(ag_cluster)[55382]:    INFO: notify: SEQUENCE_NUMBER: 61890478735371
>Jul 19 14:45:01  ag(ag_cluster)[55382]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:06  ag(ag_cluster)[55486]:    INFO: mssql_validate
>Jul 19 14:45:06  ag(ag_cluster)[55486]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:06  ag(ag_cluster)[55486]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:06  ag(ag_cluster)[55486]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:06  ag(ag_cluster)[55486]:    INFO: mssql_notify post-promote
>Jul 19 14:45:07  ag(ag_cluster)[55486]:    INFO: notify: 2023/07/19 14:45:07 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:45:07  ag(ag_cluster)[55486]:    INFO: notify: 2023/07/19 14:45:07 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:45:07  ag(ag_cluster)[55486]:    INFO: notify: 2023/07/19 14:45:07 Replica is SECONDARY (2)
>Jul 19 14:45:07  ag(ag_cluster)[55486]:    INFO: notify: 2023/07/19 14:45:07 Setting secondary to offline
>Jul 19 14:45:07  ag(ag_cluster)[55486]:    INFO: notify: 2023/07/19 14:45:07 Offlining replica...
>Jul 19 14:45:07  ag(ag_cluster)[55486]:    INFO: notify: 2023/07/19 14:45:07 Replica is RESOLVING (0)
>Jul 19 14:45:07  ag(ag_cluster)[55486]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: mssql_validate
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: mssql_monitor
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:07 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:07 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:07 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:45:07  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:07 Connected to the instance at localhost:1433
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 Monitor Caller is: monitor.
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 Replica is RESOLVING (0)
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 Instance name is server3.
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 Current master is server2.
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 Setting the role to Secondary.
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 Setting replica to SECONDARY role...
>Jul 19 14:45:12  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:12 Replica is RESOLVING (0)
>Jul 19 14:45:13  ag(ag_cluster)[55580]:    INFO: monitor: 2023/07/19 14:45:13 Replica is SECONDARY (2)
>Jul 19 14:45:13  ag(ag_cluster)[55580]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:45:13  ag(ag_cluster)[55580]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:45:13  ag(ag_cluster)[55580]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:45:13  ag(ag_cluster)[55580]:    INFO: ag_cluster monitor : 0
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: mssql_validate
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: mssql_monitor
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:13 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:13 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:13 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:45:13  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:13 Connected to the instance at localhost:1433
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:18 Monitor Caller is: monitor.
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:18 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:18 Replica is SECONDARY (2)
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:18 Instance name is server3.
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: monitor: 2023/07/19 14:45:18 Current master is server2.
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:45:18  ag(ag_cluster)[55759]:    INFO: ag_cluster monitor : 0
>Jul 19 14:45:20  ag(ag_cluster)[55915]:    INFO: mssql_validate
>Jul 19 14:45:20  ag(ag_cluster)[55915]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:20  ag(ag_cluster)[55915]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:20  ag(ag_cluster)[55915]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:20  ag(ag_cluster)[55915]:    INFO: mssql_notify pre-stop
>Jul 19 14:45:20  ag(ag_cluster)[55915]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:20  ag(ag_cluster)[55960]:    INFO: mssql_validate
>Jul 19 14:45:20  ag(ag_cluster)[55960]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:20  ag(ag_cluster)[55960]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:20  ag(ag_cluster)[55960]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:20  ag(ag_cluster)[55960]:    INFO: mssql_notify pre-stop
>Jul 19 14:45:20  ag(ag_cluster)[55960]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: mssql_validate
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: Resource agent invoked with: stop
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: mssql_stop
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: stop: 2023/07/19 14:45:20 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: stop: 2023/07/19 14:45:20 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: stop: 2023/07/19 14:45:20 Replica is SECONDARY (2)
>Jul 19 14:45:20  ag(ag_cluster)[56005]:    INFO: ag_cluster stop : 0
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: mssql_validate
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: Resource agent invoked with: start
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: mssql_start
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:42 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:42 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:42 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:45:42  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:42 Connected to the instance at localhost:1433
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Replica is SECONDARY (2)
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Sequence number is 384B:B (61894773702667)
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Line does not match expected syntax. Ignoring.
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Line does not match expected syntax. Ignoring.
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61894773702667"]
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 1 sequence numbers were found
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Max sequence number is 384B:B (61894773702667)
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Monitor Caller is: start.
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Replica is SECONDARY (2)
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Instance name is server3.
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: 2023/07/19 14:45:47 Current master is server2.
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:45:47  ag(ag_cluster)[56088]:    INFO: ag_cluster start : 0
>Jul 19 14:45:47  ag(ag_cluster)[56293]:    INFO: mssql_validate
>Jul 19 14:45:47  ag(ag_cluster)[56293]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:47  ag(ag_cluster)[56293]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:47  ag(ag_cluster)[56293]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:47  ag(ag_cluster)[56293]:    INFO: mssql_notify post-start
>Jul 19 14:45:47  ag(ag_cluster)[56293]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:48  ag(ag_cluster)[56339]:    INFO: mssql_validate
>Jul 19 14:45:48  ag(ag_cluster)[56339]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:48  ag(ag_cluster)[56339]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:48  ag(ag_cluster)[56339]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:48  ag(ag_cluster)[56339]:    INFO: mssql_notify pre-demote
>Jul 19 14:45:48  ag(ag_cluster)[56339]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:48  ag(ag_cluster)[56384]:    INFO: mssql_validate
>Jul 19 14:45:48  ag(ag_cluster)[56384]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:48  ag(ag_cluster)[56384]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:48  ag(ag_cluster)[56384]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:48  ag(ag_cluster)[56384]:    INFO: mssql_notify post-demote
>Jul 19 14:45:48  ag(ag_cluster)[56384]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:48  ag(ag_cluster)[56429]:    INFO: mssql_validate
>Jul 19 14:45:48  ag(ag_cluster)[56429]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:48  ag(ag_cluster)[56429]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:48  ag(ag_cluster)[56429]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:48  ag(ag_cluster)[56429]:    INFO: mssql_notify pre-stop
>Jul 19 14:45:48  ag(ag_cluster)[56429]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: mssql_validate
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: mssql_notify post-stop
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: notify: 2023/07/19 14:45:48 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: notify: 2023/07/19 14:45:48 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: notify: 2023/07/19 14:45:48 Replica is SECONDARY (2)
>Jul 19 14:45:48  ag(ag_cluster)[56474]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:48  ag(ag_cluster)[56548]:    INFO: mssql_validate
>Jul 19 14:45:48  ag(ag_cluster)[56548]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:48  ag(ag_cluster)[56548]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:48  ag(ag_cluster)[56548]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:48  ag(ag_cluster)[56548]:    INFO: mssql_notify pre-start
>Jul 19 14:45:49  ag(ag_cluster)[56548]:    INFO: notify: 2023/07/19 14:45:48 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:45:49  ag(ag_cluster)[56548]:    INFO: notify: 2023/07/19 14:45:48 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:45:49  ag(ag_cluster)[56548]:    INFO: notify: 2023/07/19 14:45:49 Replica is SECONDARY (2)
>Jul 19 14:45:49  ag(ag_cluster)[56548]:    INFO: notify: 2023/07/19 14:45:49 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:45:49  ag(ag_cluster)[56548]:    INFO: notify: 2023/07/19 14:45:49 Sequence number is 384B:B (61894773702667)
>Jul 19 14:45:49  ag(ag_cluster)[56548]:    INFO: notify: SEQUENCE_NUMBER: 61894773702667
>Jul 19 14:45:54  ag(ag_cluster)[56548]:    INFO: ag_cluster notify : 0
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: mssql_validate
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: Resource agent invoked with: notify
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: mssql_notify pre-start
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: notify: 2023/07/19 14:45:54 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: notify: 2023/07/19 14:45:54 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: notify: 2023/07/19 14:45:54 Replica is SECONDARY (2)
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: notify: 2023/07/19 14:45:54 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: notify: 2023/07/19 14:45:54 Sequence number is 384B:B (61894773702667)
>Jul 19 14:45:54  ag(ag_cluster)[56648]:    INFO: notify: SEQUENCE_NUMBER: 61894773702667
>Jul 19 14:45:59  ag(ag_cluster)[56648]:    INFO: ag_cluster notify : 0
>Jul 19 14:46:05  ag(ag_cluster)[56747]:    INFO: mssql_validate
>Jul 19 14:46:05  ag(ag_cluster)[56747]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:46:05  ag(ag_cluster)[56747]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:05  ag(ag_cluster)[56747]:    INFO: Resource agent invoked with: notify
>Jul 19 14:46:05  ag(ag_cluster)[56747]:    INFO: mssql_notify post-start
>Jul 19 14:46:05  ag(ag_cluster)[56747]:    INFO: ag_cluster notify : 0
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: mssql_validate
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: Resource agent invoked with: notify
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: mssql_notify pre-promote
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: notify: 2023/07/19 14:46:05 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: notify: 2023/07/19 14:46:05 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:46:05  ag(ag_cluster)[56793]:    INFO: notify: 2023/07/19 14:46:05 Connected to the instance at localhost:1433
>Jul 19 14:46:10  ag(ag_cluster)[56793]:    INFO: notify: 2023/07/19 14:46:10 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:46:10  ag(ag_cluster)[56793]:    INFO: notify: 2023/07/19 14:46:10 Sequence number is 384B:B (61894773702667)
>Jul 19 14:46:10  ag(ag_cluster)[56793]:    INFO: notify: SEQUENCE_NUMBER: 61894773702667
>Jul 19 14:46:15  ag(ag_cluster)[56793]:    INFO: ag_cluster notify : 0
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: mssql_validate
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: Resource agent invoked with: notify
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: mssql_notify pre-promote
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: notify: 2023/07/19 14:46:15 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: notify: 2023/07/19 14:46:15 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:46:15  ag(ag_cluster)[56897]:    INFO: notify: 2023/07/19 14:46:15 Connected to the instance at localhost:1433
>Jul 19 14:46:20  ag(ag_cluster)[56897]:    INFO: notify: 2023/07/19 14:46:20 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:46:20  ag(ag_cluster)[56897]:    INFO: notify: 2023/07/19 14:46:20 Sequence number is 384B:B (61894773702667)
>Jul 19 14:46:20  ag(ag_cluster)[56897]:    INFO: notify: SEQUENCE_NUMBER: 61894773702667
>Jul 19 14:46:25  ag(ag_cluster)[56897]:    INFO: ag_cluster notify : 0
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: mssql_validate
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: Resource agent invoked with: notify
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: mssql_notify post-promote
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: notify: 2023/07/19 14:46:31 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: notify: 2023/07/19 14:46:31 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: notify: 2023/07/19 14:46:31 Replica is SECONDARY (2)
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: notify: 2023/07/19 14:46:31 Setting secondary to offline
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: notify: 2023/07/19 14:46:31 Offlining replica...
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: notify: 2023/07/19 14:46:31 Replica is RESOLVING (0)
>Jul 19 14:46:31  ag(ag_cluster)[57001]:    INFO: ag_cluster notify : 0
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: mssql_validate
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: mssql_monitor
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:31 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:31 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:31 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:46:31  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:31 Connected to the instance at localhost:1433
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 Monitor Caller is: monitor.
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 Replica is RESOLVING (0)
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 Instance name is server3.
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 Current master is server2.
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 Setting the role to Secondary.
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 Setting replica to SECONDARY role...
>Jul 19 14:46:36  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:36 Replica is RESOLVING (0)
>Jul 19 14:46:37  ag(ag_cluster)[57095]:    INFO: monitor: 2023/07/19 14:46:37 Replica is SECONDARY (2)
>Jul 19 14:46:37  ag(ag_cluster)[57095]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:46:37  ag(ag_cluster)[57095]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:46:37  ag(ag_cluster)[57095]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:46:37  ag(ag_cluster)[57095]:    INFO: ag_cluster monitor : 0
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: mssql_validate
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: mssql_monitor
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:37 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:37 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:37 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:46:37  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:37 Connected to the instance at localhost:1433
>Jul 19 14:46:42  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:42 Monitor Caller is: monitor.
>Jul 19 14:46:42  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:42 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:46:42  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:42 Replica is SECONDARY (2)
>Jul 19 14:46:42  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:42 Instance name is server3.
>Jul 19 14:46:42  ag(ag_cluster)[57276]:    INFO: monitor: 2023/07/19 14:46:42 Current master is server2.
>Jul 19 14:46:42  ag(ag_cluster)[57276]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:46:43  ag(ag_cluster)[57276]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:46:43  ag(ag_cluster)[57276]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:46:43  ag(ag_cluster)[57276]:    INFO: ag_cluster monitor : 0
>Jul 19 14:46:43  ag(ag_cluster)[57430]:    INFO: mssql_validate
>Jul 19 14:46:43  ag(ag_cluster)[57430]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:46:43  ag(ag_cluster)[57430]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:43  ag(ag_cluster)[57430]:    INFO: Resource agent invoked with: notify
>Jul 19 14:46:43  ag(ag_cluster)[57430]:    INFO: mssql_notify pre-stop
>Jul 19 14:46:43  ag(ag_cluster)[57430]:    INFO: ag_cluster notify : 0
>Jul 19 14:46:43  ag(ag_cluster)[57475]:    INFO: mssql_validate
>Jul 19 14:46:43  ag(ag_cluster)[57475]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:46:43  ag(ag_cluster)[57475]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:46:43  ag(ag_cluster)[57475]:    INFO: Resource agent invoked with: notify
>Jul 19 14:46:43  ag(ag_cluster)[57475]:    INFO: mssql_notify pre-stop
>Jul 19 14:46:43  ag(ag_cluster)[57475]:    INFO: ag_cluster notify : 0
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: mssql_validate
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: Resource agent invoked with: stop
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: mssql_stop
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: stop: 2023/07/19 14:46:43 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: stop: 2023/07/19 14:46:43 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: stop: 2023/07/19 14:46:43 Replica is SECONDARY (2)
>Jul 19 14:46:43  ag(ag_cluster)[57520]:    INFO: ag_cluster stop : 0
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: mssql_validate
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: Resource agent invoked with: start
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: mssql_start
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:05 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:05 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:05 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:47:05  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:05 Connected to the instance at localhost:1433
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Replica is SECONDARY (2)
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Sequence number is 384C:7 (61899068669959)
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Line does not match expected syntax. Ignoring.
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Line does not match expected syntax. Ignoring.
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61899068669959"]
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 1 sequence numbers were found
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Max sequence number is 384C:7 (61899068669959)
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Monitor Caller is: start.
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Replica is SECONDARY (2)
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Instance name is server3.
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: 2023/07/19 14:47:10 Current master is server2.
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:47:10  ag(ag_cluster)[57612]:    INFO: ag_cluster start : 0
>Jul 19 14:47:11  ag(ag_cluster)[57811]:    INFO: mssql_validate
>Jul 19 14:47:11  ag(ag_cluster)[57811]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:11  ag(ag_cluster)[57811]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:11  ag(ag_cluster)[57811]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:11  ag(ag_cluster)[57811]:    INFO: mssql_notify post-start
>Jul 19 14:47:11  ag(ag_cluster)[57811]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:11  ag(ag_cluster)[57857]:    INFO: mssql_validate
>Jul 19 14:47:11  ag(ag_cluster)[57857]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:11  ag(ag_cluster)[57857]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:11  ag(ag_cluster)[57857]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:11  ag(ag_cluster)[57857]:    INFO: mssql_notify pre-demote
>Jul 19 14:47:11  ag(ag_cluster)[57857]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:11  ag(ag_cluster)[57902]:    INFO: mssql_validate
>Jul 19 14:47:11  ag(ag_cluster)[57902]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:11  ag(ag_cluster)[57902]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:11  ag(ag_cluster)[57902]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:11  ag(ag_cluster)[57902]:    INFO: mssql_notify post-demote
>Jul 19 14:47:11  ag(ag_cluster)[57902]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:11  ag(ag_cluster)[57947]:    INFO: mssql_validate
>Jul 19 14:47:11  ag(ag_cluster)[57947]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:11  ag(ag_cluster)[57947]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:11  ag(ag_cluster)[57947]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:11  ag(ag_cluster)[57947]:    INFO: mssql_notify pre-stop
>Jul 19 14:47:11  ag(ag_cluster)[57947]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: mssql_validate
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: mssql_notify post-stop
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: notify: 2023/07/19 14:47:12 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: notify: 2023/07/19 14:47:12 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: notify: 2023/07/19 14:47:12 Replica is SECONDARY (2)
>Jul 19 14:47:12  ag(ag_cluster)[57992]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: mssql_validate
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: mssql_notify pre-start
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: notify: 2023/07/19 14:47:12 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: notify: 2023/07/19 14:47:12 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: notify: 2023/07/19 14:47:12 Replica is SECONDARY (2)
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: notify: 2023/07/19 14:47:12 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: notify: 2023/07/19 14:47:12 Sequence number is 384C:7 (61899068669959)
>Jul 19 14:47:12  ag(ag_cluster)[58066]:    INFO: notify: SEQUENCE_NUMBER: 61899068669959
>Jul 19 14:47:17  ag(ag_cluster)[58066]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: mssql_validate
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: mssql_notify pre-start
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: notify: 2023/07/19 14:47:17 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: notify: 2023/07/19 14:47:17 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: notify: 2023/07/19 14:47:17 Replica is SECONDARY (2)
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: notify: 2023/07/19 14:47:17 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: notify: 2023/07/19 14:47:17 Sequence number is 384C:7 (61899068669959)
>Jul 19 14:47:17  ag(ag_cluster)[58164]:    INFO: notify: SEQUENCE_NUMBER: 61899068669959
>Jul 19 14:47:22  ag(ag_cluster)[58164]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:28  ag(ag_cluster)[58265]:    INFO: mssql_validate
>Jul 19 14:47:28  ag(ag_cluster)[58265]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:28  ag(ag_cluster)[58265]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:28  ag(ag_cluster)[58265]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:28  ag(ag_cluster)[58265]:    INFO: mssql_notify post-start
>Jul 19 14:47:28  ag(ag_cluster)[58265]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: mssql_validate
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: mssql_notify pre-promote
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: notify: 2023/07/19 14:47:28 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: notify: 2023/07/19 14:47:28 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:47:28  ag(ag_cluster)[58311]:    INFO: notify: 2023/07/19 14:47:28 Connected to the instance at localhost:1433
>Jul 19 14:47:33  ag(ag_cluster)[58311]:    INFO: notify: 2023/07/19 14:47:33 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:47:33  ag(ag_cluster)[58311]:    INFO: notify: 2023/07/19 14:47:33 Sequence number is 384C:7 (61899068669959)
>Jul 19 14:47:33  ag(ag_cluster)[58311]:    INFO: notify: SEQUENCE_NUMBER: 61899068669959
>Jul 19 14:47:38  ag(ag_cluster)[58311]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: mssql_validate
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: mssql_notify pre-promote
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: notify: 2023/07/19 14:47:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: notify: 2023/07/19 14:47:38 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:47:38  ag(ag_cluster)[58415]:    INFO: notify: 2023/07/19 14:47:38 Connected to the instance at localhost:1433
>Jul 19 14:47:43  ag(ag_cluster)[58415]:    INFO: notify: 2023/07/19 14:47:43 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:47:43  ag(ag_cluster)[58415]:    INFO: notify: 2023/07/19 14:47:43 Sequence number is 384C:7 (61899068669959)
>Jul 19 14:47:43  ag(ag_cluster)[58415]:    INFO: notify: SEQUENCE_NUMBER: 61899068669959
>Jul 19 14:47:48  ag(ag_cluster)[58415]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: mssql_validate
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: Resource agent invoked with: notify
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: mssql_notify post-promote
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: notify: 2023/07/19 14:47:54 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: notify: 2023/07/19 14:47:54 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: notify: 2023/07/19 14:47:54 Replica is SECONDARY (2)
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: notify: 2023/07/19 14:47:54 Setting secondary to offline
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: notify: 2023/07/19 14:47:54 Offlining replica...
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: notify: 2023/07/19 14:47:54 Replica is RESOLVING (0)
>Jul 19 14:47:54  ag(ag_cluster)[58535]:    INFO: ag_cluster notify : 0
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: mssql_validate
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: mssql_monitor
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:54 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:54 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:54 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:47:54  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:54 Connected to the instance at localhost:1433
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 Monitor Caller is: monitor.
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 Replica is RESOLVING (0)
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 Instance name is server3.
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 Current master is server2.
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 Setting the role to Secondary.
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 Setting replica to SECONDARY role...
>Jul 19 14:47:59  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:47:59 Replica is RESOLVING (0)
>Jul 19 14:48:00  ag(ag_cluster)[58629]:    INFO: monitor: 2023/07/19 14:48:00 Replica is SECONDARY (2)
>Jul 19 14:48:00  ag(ag_cluster)[58629]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:48:00  ag(ag_cluster)[58629]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:48:00  ag(ag_cluster)[58629]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:48:00  ag(ag_cluster)[58629]:    INFO: ag_cluster monitor : 0
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: mssql_validate
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: mssql_monitor
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:01 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:01 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:01 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:48:01  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:01 Connected to the instance at localhost:1433
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:06 Monitor Caller is: monitor.
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:06 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:06 Replica is SECONDARY (2)
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:06 Instance name is server3.
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: monitor: 2023/07/19 14:48:06 Current master is server2.
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:48:06  ag(ag_cluster)[58806]:    INFO: ag_cluster monitor : 0
>Jul 19 14:48:06  ag(ag_cluster)[58961]:    INFO: mssql_validate
>Jul 19 14:48:06  ag(ag_cluster)[58961]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:06  ag(ag_cluster)[58961]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:06  ag(ag_cluster)[58961]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:06  ag(ag_cluster)[58961]:    INFO: mssql_notify pre-stop
>Jul 19 14:48:06  ag(ag_cluster)[58961]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:06  ag(ag_cluster)[59006]:    INFO: mssql_validate
>Jul 19 14:48:06  ag(ag_cluster)[59006]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:06  ag(ag_cluster)[59006]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:06  ag(ag_cluster)[59006]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:06  ag(ag_cluster)[59006]:    INFO: mssql_notify pre-stop
>Jul 19 14:48:06  ag(ag_cluster)[59006]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: mssql_validate
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: Resource agent invoked with: stop
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: mssql_stop
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: stop: 2023/07/19 14:48:06 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: stop: 2023/07/19 14:48:06 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: stop: 2023/07/19 14:48:06 Replica is SECONDARY (2)
>Jul 19 14:48:06  ag(ag_cluster)[59051]:    INFO: ag_cluster stop : 0
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: mssql_validate
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: Resource agent invoked with: start
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: mssql_start
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:28 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:28 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server1
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: start: server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:28 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:48:28  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:28 Connected to the instance at localhost:1433
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Replica is SECONDARY (2)
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Sequence number is 384D:7 (61903363637255)
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Line does not match expected syntax. Ignoring.
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Line does not match expected syntax. Ignoring.
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61903363637255"]
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 1 sequence numbers were found
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Max sequence number is 384D:7 (61903363637255)
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Monitor Caller is: start.
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Replica is SECONDARY (2)
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Instance name is server3.
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: 2023/07/19 14:48:33 Current master is server1
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: server2.
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:48:33  ag(ag_cluster)[59135]:    INFO: ag_cluster start : 0
>Jul 19 14:48:33  ag(ag_cluster)[59344]:    INFO: mssql_validate
>Jul 19 14:48:33  ag(ag_cluster)[59344]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:33  ag(ag_cluster)[59344]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:33  ag(ag_cluster)[59344]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:33  ag(ag_cluster)[59344]:    INFO: mssql_notify post-start
>Jul 19 14:48:33  ag(ag_cluster)[59344]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:34  ag(ag_cluster)[59390]:    INFO: mssql_validate
>Jul 19 14:48:34  ag(ag_cluster)[59390]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:34  ag(ag_cluster)[59390]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:34  ag(ag_cluster)[59390]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:34  ag(ag_cluster)[59390]:    INFO: mssql_notify pre-demote
>Jul 19 14:48:34  ag(ag_cluster)[59390]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:34  ag(ag_cluster)[59435]:    INFO: mssql_validate
>Jul 19 14:48:34  ag(ag_cluster)[59435]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:34  ag(ag_cluster)[59435]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:34  ag(ag_cluster)[59435]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:34  ag(ag_cluster)[59435]:    INFO: mssql_notify post-demote
>Jul 19 14:48:34  ag(ag_cluster)[59435]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:34  ag(ag_cluster)[59480]:    INFO: mssql_validate
>Jul 19 14:48:34  ag(ag_cluster)[59480]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:34  ag(ag_cluster)[59480]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:34  ag(ag_cluster)[59480]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:34  ag(ag_cluster)[59480]:    INFO: mssql_notify pre-stop
>Jul 19 14:48:34  ag(ag_cluster)[59480]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: mssql_validate
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: mssql_notify post-stop
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: notify: 2023/07/19 14:48:34 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: notify: 2023/07/19 14:48:34 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: notify: 2023/07/19 14:48:34 Replica is SECONDARY (2)
>Jul 19 14:48:34  ag(ag_cluster)[59525]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:34  ag(ag_cluster)[59600]:    INFO: mssql_validate
>Jul 19 14:48:34  ag(ag_cluster)[59600]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:34  ag(ag_cluster)[59600]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:34  ag(ag_cluster)[59600]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:35  ag(ag_cluster)[59600]:    INFO: mssql_notify pre-start
>Jul 19 14:48:35  ag(ag_cluster)[59600]:    INFO: notify: 2023/07/19 14:48:35 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:48:35  ag(ag_cluster)[59600]:    INFO: notify: 2023/07/19 14:48:35 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:48:35  ag(ag_cluster)[59600]:    INFO: notify: 2023/07/19 14:48:35 Replica is SECONDARY (2)
>Jul 19 14:48:35  ag(ag_cluster)[59600]:    INFO: notify: 2023/07/19 14:48:35 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:48:35  ag(ag_cluster)[59600]:    INFO: notify: 2023/07/19 14:48:35 Sequence number is 384D:7 (61903363637255)
>Jul 19 14:48:35  ag(ag_cluster)[59600]:    INFO: notify: SEQUENCE_NUMBER: 61903363637255
>Jul 19 14:48:40  ag(ag_cluster)[59600]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: mssql_validate
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: mssql_notify pre-start
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: notify: 2023/07/19 14:48:40 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: notify: 2023/07/19 14:48:40 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: notify: 2023/07/19 14:48:40 Replica is SECONDARY (2)
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: notify: 2023/07/19 14:48:40 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: notify: 2023/07/19 14:48:40 Sequence number is 384D:7 (61903363637255)
>Jul 19 14:48:40  ag(ag_cluster)[59699]:    INFO: notify: SEQUENCE_NUMBER: 61903363637255
>Jul 19 14:48:45  ag(ag_cluster)[59699]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:50  ag(ag_cluster)[59807]:    INFO: mssql_validate
>Jul 19 14:48:50  ag(ag_cluster)[59807]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:50  ag(ag_cluster)[59807]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:51  ag(ag_cluster)[59807]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:51  ag(ag_cluster)[59807]:    INFO: mssql_notify post-start
>Jul 19 14:48:51  ag(ag_cluster)[59807]:    INFO: ag_cluster notify : 0
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: mssql_validate
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: Resource agent invoked with: notify
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: mssql_notify pre-promote
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: notify: 2023/07/19 14:48:51 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: notify: 2023/07/19 14:48:51 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:48:51  ag(ag_cluster)[59853]:    INFO: notify: 2023/07/19 14:48:51 Connected to the instance at localhost:1433
>Jul 19 14:48:56  ag(ag_cluster)[59853]:    INFO: notify: 2023/07/19 14:48:56 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:48:56  ag(ag_cluster)[59853]:    INFO: notify: 2023/07/19 14:48:56 Sequence number is 384D:7 (61903363637255)
>Jul 19 14:48:56  ag(ag_cluster)[59853]:    INFO: notify: SEQUENCE_NUMBER: 61903363637255
>Jul 19 14:49:01  ag(ag_cluster)[59853]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: mssql_validate
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: mssql_notify pre-promote
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: notify: 2023/07/19 14:49:01 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: notify: 2023/07/19 14:49:01 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:49:01  ag(ag_cluster)[59956]:    INFO: notify: 2023/07/19 14:49:01 Connected to the instance at localhost:1433
>Jul 19 14:49:06  ag(ag_cluster)[59956]:    INFO: notify: 2023/07/19 14:49:06 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:49:06  ag(ag_cluster)[59956]:    INFO: notify: 2023/07/19 14:49:06 Sequence number is 384D:7 (61903363637255)
>Jul 19 14:49:06  ag(ag_cluster)[59956]:    INFO: notify: SEQUENCE_NUMBER: 61903363637255
>Jul 19 14:49:11  ag(ag_cluster)[59956]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: mssql_validate
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: mssql_notify post-promote
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: notify: 2023/07/19 14:49:17 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: notify: 2023/07/19 14:49:17 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: notify: 2023/07/19 14:49:17 Replica is SECONDARY (2)
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: notify: 2023/07/19 14:49:17 Setting secondary to offline
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: notify: 2023/07/19 14:49:17 Offlining replica...
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: notify: 2023/07/19 14:49:17 Replica is RESOLVING (0)
>Jul 19 14:49:17  ag(ag_cluster)[60061]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: mssql_validate
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: mssql_monitor
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:17 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:17 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:17 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:49:17  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:17 Connected to the instance at localhost:1433
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 Monitor Caller is: monitor.
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 Replica is RESOLVING (0)
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 Instance name is server3.
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 Current master is server2.
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 Setting the role to Secondary.
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 Setting replica to SECONDARY role...
>Jul 19 14:49:22  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:22 Replica is RESOLVING (0)
>Jul 19 14:49:23  ag(ag_cluster)[60154]:    INFO: monitor: 2023/07/19 14:49:23 Replica is SECONDARY (2)
>Jul 19 14:49:23  ag(ag_cluster)[60154]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:49:23  ag(ag_cluster)[60154]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:49:23  ag(ag_cluster)[60154]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:49:23  ag(ag_cluster)[60154]:    INFO: ag_cluster monitor : 0
>Jul 19 14:49:23  ag(ag_cluster)[60334]:    INFO: mssql_validate
>Jul 19 14:49:23  ag(ag_cluster)[60334]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:49:23  ag(ag_cluster)[60334]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:23  ag(ag_cluster)[60334]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:49:23  ag(ag_cluster)[60334]:    INFO: mssql_monitor
>Jul 19 14:49:23  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:23 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:49:23  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:23 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:49:24  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:23 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:49:24  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:24 Connected to the instance at localhost:1433
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:29 Monitor Caller is: monitor.
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:29 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:29 Replica is SECONDARY (2)
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:29 Instance name is server3.
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: monitor: 2023/07/19 14:49:29 Current master is server2.
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:49:29  ag(ag_cluster)[60334]:    INFO: ag_cluster monitor : 0
>Jul 19 14:49:29  ag(ag_cluster)[60487]:    INFO: mssql_validate
>Jul 19 14:49:29  ag(ag_cluster)[60487]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:29  ag(ag_cluster)[60487]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:29  ag(ag_cluster)[60487]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:29  ag(ag_cluster)[60487]:    INFO: mssql_notify pre-stop
>Jul 19 14:49:29  ag(ag_cluster)[60487]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:29  ag(ag_cluster)[60532]:    INFO: mssql_validate
>Jul 19 14:49:29  ag(ag_cluster)[60532]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:29  ag(ag_cluster)[60532]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:29  ag(ag_cluster)[60532]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:29  ag(ag_cluster)[60532]:    INFO: mssql_notify pre-stop
>Jul 19 14:49:29  ag(ag_cluster)[60532]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: mssql_validate
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: Resource agent invoked with: stop
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: mssql_stop
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: stop: 2023/07/19 14:49:29 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: stop: 2023/07/19 14:49:29 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: stop: 2023/07/19 14:49:29 Replica is SECONDARY (2)
>Jul 19 14:49:29  ag(ag_cluster)[60577]:    INFO: ag_cluster stop : 0
>Jul 19 14:49:50  ag(ag_cluster)[60667]:    INFO: mssql_validate
>Jul 19 14:49:50  ag(ag_cluster)[60667]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:50  ag(ag_cluster)[60667]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:50  ag(ag_cluster)[60667]:    INFO: Resource agent invoked with: start
>Jul 19 14:49:50  ag(ag_cluster)[60667]:    INFO: mssql_start
>Jul 19 14:49:51  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:51 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:49:51  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:51 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:49:51  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:51 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:49:51  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:51 Connected to the instance at localhost:1433
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Replica is SECONDARY (2)
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Sequence number is 384E:B (61907658604555)
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Line does not match expected syntax. Ignoring.
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Line does not match expected syntax. Ignoring.
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61907658604555"]
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 1 sequence numbers were found
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Max sequence number is 384E:B (61907658604555)
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Monitor Caller is: start.
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Replica is SECONDARY (2)
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Instance name is server3.
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: 2023/07/19 14:49:56 Current master is server2.
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:49:56  ag(ag_cluster)[60667]:    INFO: ag_cluster start : 0
>Jul 19 14:49:56  ag(ag_cluster)[60867]:    INFO: mssql_validate
>Jul 19 14:49:56  ag(ag_cluster)[60867]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:56  ag(ag_cluster)[60867]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:56  ag(ag_cluster)[60867]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:56  ag(ag_cluster)[60867]:    INFO: mssql_notify post-start
>Jul 19 14:49:56  ag(ag_cluster)[60867]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:57  ag(ag_cluster)[60913]:    INFO: mssql_validate
>Jul 19 14:49:57  ag(ag_cluster)[60913]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:57  ag(ag_cluster)[60913]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:57  ag(ag_cluster)[60913]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:57  ag(ag_cluster)[60913]:    INFO: mssql_notify pre-demote
>Jul 19 14:49:57  ag(ag_cluster)[60913]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:57  ag(ag_cluster)[60958]:    INFO: mssql_validate
>Jul 19 14:49:57  ag(ag_cluster)[60958]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:57  ag(ag_cluster)[60958]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:57  ag(ag_cluster)[60958]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:57  ag(ag_cluster)[60958]:    INFO: mssql_notify post-demote
>Jul 19 14:49:57  ag(ag_cluster)[60958]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:57  ag(ag_cluster)[61003]:    INFO: mssql_validate
>Jul 19 14:49:57  ag(ag_cluster)[61003]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:57  ag(ag_cluster)[61003]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:57  ag(ag_cluster)[61003]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:57  ag(ag_cluster)[61003]:    INFO: mssql_notify pre-stop
>Jul 19 14:49:57  ag(ag_cluster)[61003]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:57  ag(ag_cluster)[61048]:    INFO: mssql_validate
>Jul 19 14:49:57  ag(ag_cluster)[61048]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:57  ag(ag_cluster)[61048]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:57  ag(ag_cluster)[61048]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:57  ag(ag_cluster)[61048]:    INFO: mssql_notify post-stop
>Jul 19 14:49:58  ag(ag_cluster)[61048]:    INFO: notify: 2023/07/19 14:49:58 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:49:58  ag(ag_cluster)[61048]:    INFO: notify: 2023/07/19 14:49:58 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:49:58  ag(ag_cluster)[61048]:    INFO: notify: 2023/07/19 14:49:58 Replica is SECONDARY (2)
>Jul 19 14:49:58  ag(ag_cluster)[61048]:    INFO: ag_cluster notify : 0
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: mssql_validate
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: Resource agent invoked with: notify
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: mssql_notify pre-start
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: notify: 2023/07/19 14:49:58 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: notify: 2023/07/19 14:49:58 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: notify: 2023/07/19 14:49:58 Replica is SECONDARY (2)
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: notify: 2023/07/19 14:49:58 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: notify: 2023/07/19 14:49:58 Sequence number is 384E:B (61907658604555)
>Jul 19 14:49:58  ag(ag_cluster)[61123]:    INFO: notify: SEQUENCE_NUMBER: 61907658604555
>Jul 19 14:50:03  ag(ag_cluster)[61123]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: mssql_validate
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: Resource agent invoked with: notify
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: mssql_notify pre-start
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: notify: 2023/07/19 14:50:03 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: notify: 2023/07/19 14:50:03 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: notify: 2023/07/19 14:50:03 Replica is SECONDARY (2)
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: notify: 2023/07/19 14:50:03 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: notify: 2023/07/19 14:50:03 Sequence number is 384E:B (61907658604555)
>Jul 19 14:50:03  ag(ag_cluster)[61225]:    INFO: notify: SEQUENCE_NUMBER: 61907658604555
>Jul 19 14:50:08  ag(ag_cluster)[61225]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:14  ag(ag_cluster)[61326]:    INFO: mssql_validate
>Jul 19 14:50:14  ag(ag_cluster)[61326]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:14  ag(ag_cluster)[61326]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:14  ag(ag_cluster)[61326]:    INFO: Resource agent invoked with: notify
>Jul 19 14:50:14  ag(ag_cluster)[61326]:    INFO: mssql_notify post-start
>Jul 19 14:50:14  ag(ag_cluster)[61326]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: mssql_validate
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: Resource agent invoked with: notify
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: mssql_notify pre-promote
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: notify: 2023/07/19 14:50:14 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: notify: 2023/07/19 14:50:14 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:50:14  ag(ag_cluster)[61372]:    INFO: notify: 2023/07/19 14:50:14 Connected to the instance at localhost:1433
>Jul 19 14:50:19  ag(ag_cluster)[61372]:    INFO: notify: 2023/07/19 14:50:19 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:50:19  ag(ag_cluster)[61372]:    INFO: notify: 2023/07/19 14:50:19 Sequence number is 384E:B (61907658604555)
>Jul 19 14:50:19  ag(ag_cluster)[61372]:    INFO: notify: SEQUENCE_NUMBER: 61907658604555
>Jul 19 14:50:24  ag(ag_cluster)[61372]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: mssql_validate
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: Resource agent invoked with: notify
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: mssql_notify pre-promote
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: notify: 2023/07/19 14:50:24 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: notify: 2023/07/19 14:50:24 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:50:24  ag(ag_cluster)[61478]:    INFO: notify: 2023/07/19 14:50:24 Connected to the instance at localhost:1433
>Jul 19 14:50:30  ag(ag_cluster)[61478]:    INFO: notify: 2023/07/19 14:50:29 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:50:30  ag(ag_cluster)[61478]:    INFO: notify: 2023/07/19 14:50:29 Sequence number is 384E:B (61907658604555)
>Jul 19 14:50:30  ag(ag_cluster)[61478]:    INFO: notify: SEQUENCE_NUMBER: 61907658604555
>Jul 19 14:50:35  ag(ag_cluster)[61478]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: mssql_validate
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: Resource agent invoked with: notify
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: mssql_notify post-promote
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: notify: 2023/07/19 14:50:40 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: notify: 2023/07/19 14:50:40 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: notify: 2023/07/19 14:50:40 Replica is SECONDARY (2)
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: notify: 2023/07/19 14:50:40 Setting secondary to offline
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: notify: 2023/07/19 14:50:40 Offlining replica...
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: notify: 2023/07/19 14:50:40 Replica is RESOLVING (0)
>Jul 19 14:50:40  ag(ag_cluster)[61581]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: mssql_validate
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: mssql_monitor
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:41 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:41 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:41 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:50:41  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:41 Connected to the instance at localhost:1433
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 Monitor Caller is: monitor.
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 Replica is RESOLVING (0)
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 Instance name is server3.
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 Current master is server2.
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 Setting the role to Secondary.
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 Setting replica to SECONDARY role...
>Jul 19 14:50:46  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:46 Replica is RESOLVING (0)
>Jul 19 14:50:47  ag(ag_cluster)[61675]:    INFO: monitor: 2023/07/19 14:50:47 Replica is SECONDARY (2)
>Jul 19 14:50:47  ag(ag_cluster)[61675]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:50:47  ag(ag_cluster)[61675]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:50:47  ag(ag_cluster)[61675]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:50:47  ag(ag_cluster)[61675]:    INFO: ag_cluster monitor : 0
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: mssql_validate
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: mssql_monitor
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:47 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:47 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:47 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:50:47  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:47 Connected to the instance at localhost:1433
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:52 Monitor Caller is: monitor.
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:52 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:52 Replica is SECONDARY (2)
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:52 Instance name is server3.
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: monitor: 2023/07/19 14:50:52 Current master is server2.
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:50:52  ag(ag_cluster)[61860]:    INFO: ag_cluster monitor : 0
>Jul 19 14:50:52  ag(ag_cluster)[62015]:    INFO: mssql_validate
>Jul 19 14:50:52  ag(ag_cluster)[62015]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:52  ag(ag_cluster)[62015]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:52  ag(ag_cluster)[62015]:    INFO: Resource agent invoked with: notify
>Jul 19 14:50:53  ag(ag_cluster)[62015]:    INFO: mssql_notify pre-stop
>Jul 19 14:50:53  ag(ag_cluster)[62015]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:53  ag(ag_cluster)[62060]:    INFO: mssql_validate
>Jul 19 14:50:53  ag(ag_cluster)[62060]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:53  ag(ag_cluster)[62060]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:50:53  ag(ag_cluster)[62060]:    INFO: Resource agent invoked with: notify
>Jul 19 14:50:53  ag(ag_cluster)[62060]:    INFO: mssql_notify pre-stop
>Jul 19 14:50:53  ag(ag_cluster)[62060]:    INFO: ag_cluster notify : 0
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: mssql_validate
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: Resource agent invoked with: stop
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: mssql_stop
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: stop: 2023/07/19 14:50:53 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: stop: 2023/07/19 14:50:53 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: stop: 2023/07/19 14:50:53 Replica is SECONDARY (2)
>Jul 19 14:50:53  ag(ag_cluster)[62105]:    INFO: ag_cluster stop : 0
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: mssql_validate
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: Resource agent invoked with: start
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: mssql_start
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:15 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:15 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:15 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:51:15  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:15 Connected to the instance at localhost:1433
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Replica is SECONDARY (2)
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Sequence number is 384F:B (61911953571851)
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Line does not match expected syntax. Ignoring.
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Line does not match expected syntax. Ignoring.
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61911953571851"]
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 1 sequence numbers were found
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Max sequence number is 384F:B (61911953571851)
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Monitor Caller is: start.
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Replica is SECONDARY (2)
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Instance name is server3.
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: 2023/07/19 14:51:20 Current master is server2.
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:51:20  ag(ag_cluster)[62187]:    INFO: ag_cluster start : 0
>Jul 19 14:51:20  ag(ag_cluster)[62387]:    INFO: mssql_validate
>Jul 19 14:51:20  ag(ag_cluster)[62387]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:20  ag(ag_cluster)[62387]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:20  ag(ag_cluster)[62387]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:20  ag(ag_cluster)[62387]:    INFO: mssql_notify post-start
>Jul 19 14:51:20  ag(ag_cluster)[62387]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:21  ag(ag_cluster)[62433]:    INFO: mssql_validate
>Jul 19 14:51:21  ag(ag_cluster)[62433]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:21  ag(ag_cluster)[62433]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:21  ag(ag_cluster)[62433]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:21  ag(ag_cluster)[62433]:    INFO: mssql_notify pre-demote
>Jul 19 14:51:21  ag(ag_cluster)[62433]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:21  ag(ag_cluster)[62478]:    INFO: mssql_validate
>Jul 19 14:51:21  ag(ag_cluster)[62478]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:21  ag(ag_cluster)[62478]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:21  ag(ag_cluster)[62478]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:21  ag(ag_cluster)[62478]:    INFO: mssql_notify post-demote
>Jul 19 14:51:21  ag(ag_cluster)[62478]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:21  ag(ag_cluster)[62523]:    INFO: mssql_validate
>Jul 19 14:51:21  ag(ag_cluster)[62523]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:21  ag(ag_cluster)[62523]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:21  ag(ag_cluster)[62523]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:21  ag(ag_cluster)[62523]:    INFO: mssql_notify pre-stop
>Jul 19 14:51:21  ag(ag_cluster)[62523]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: mssql_validate
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: mssql_notify post-stop
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: notify: 2023/07/19 14:51:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: notify: 2023/07/19 14:51:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: notify: 2023/07/19 14:51:21 Replica is SECONDARY (2)
>Jul 19 14:51:21  ag(ag_cluster)[62568]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: mssql_validate
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: mssql_notify pre-start
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: notify: 2023/07/19 14:51:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: notify: 2023/07/19 14:51:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: notify: 2023/07/19 14:51:21 Replica is SECONDARY (2)
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: notify: 2023/07/19 14:51:21 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: notify: 2023/07/19 14:51:21 Sequence number is 384F:B (61911953571851)
>Jul 19 14:51:21  ag(ag_cluster)[62643]:    INFO: notify: SEQUENCE_NUMBER: 61911953571851
>Jul 19 14:51:26  ag(ag_cluster)[62643]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: mssql_validate
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: mssql_notify pre-start
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: notify: 2023/07/19 14:51:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: notify: 2023/07/19 14:51:26 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: notify: 2023/07/19 14:51:26 Replica is SECONDARY (2)
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: notify: 2023/07/19 14:51:26 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: notify: 2023/07/19 14:51:26 Sequence number is 384F:B (61911953571851)
>Jul 19 14:51:26  ag(ag_cluster)[62743]:    INFO: notify: SEQUENCE_NUMBER: 61911953571851
>Jul 19 14:51:31  ag(ag_cluster)[62743]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:37  ag(ag_cluster)[62841]:    INFO: mssql_validate
>Jul 19 14:51:37  ag(ag_cluster)[62841]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:37  ag(ag_cluster)[62841]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:37  ag(ag_cluster)[62841]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:37  ag(ag_cluster)[62841]:    INFO: mssql_notify post-start
>Jul 19 14:51:37  ag(ag_cluster)[62841]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: mssql_validate
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: mssql_notify pre-promote
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: notify: 2023/07/19 14:51:37 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: notify: 2023/07/19 14:51:37 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:51:37  ag(ag_cluster)[62887]:    INFO: notify: 2023/07/19 14:51:37 Connected to the instance at localhost:1433
>Jul 19 14:51:42  ag(ag_cluster)[62887]:    INFO: notify: 2023/07/19 14:51:42 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:51:42  ag(ag_cluster)[62887]:    INFO: notify: 2023/07/19 14:51:42 Sequence number is 384F:B (61911953571851)
>Jul 19 14:51:42  ag(ag_cluster)[62887]:    INFO: notify: SEQUENCE_NUMBER: 61911953571851
>Jul 19 14:51:47  ag(ag_cluster)[62887]:    INFO: ag_cluster notify : 0
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: mssql_validate
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: Resource agent invoked with: notify
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: mssql_notify pre-promote
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: notify: 2023/07/19 14:51:48 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: notify: 2023/07/19 14:51:48 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:51:48  ag(ag_cluster)[62999]:    INFO: notify: 2023/07/19 14:51:48 Connected to the instance at localhost:1433
>Jul 19 14:51:53  ag(ag_cluster)[62999]:    INFO: notify: 2023/07/19 14:51:53 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:51:53  ag(ag_cluster)[62999]:    INFO: notify: 2023/07/19 14:51:53 Sequence number is 384F:B (61911953571851)
>Jul 19 14:51:53  ag(ag_cluster)[62999]:    INFO: notify: SEQUENCE_NUMBER: 61911953571851
>Jul 19 14:51:58  ag(ag_cluster)[62999]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:03  ag(ag_cluster)[63107]:    INFO: mssql_validate
>Jul 19 14:52:03  ag(ag_cluster)[63107]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:03  ag(ag_cluster)[63107]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:03  ag(ag_cluster)[63107]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: mssql_notify post-promote
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: notify: 2023/07/19 14:52:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: notify: 2023/07/19 14:52:04 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: notify: 2023/07/19 14:52:04 Replica is SECONDARY (2)
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: notify: 2023/07/19 14:52:04 Setting secondary to offline
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: notify: 2023/07/19 14:52:04 Offlining replica...
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: notify: 2023/07/19 14:52:04 Replica is RESOLVING (0)
>Jul 19 14:52:04  ag(ag_cluster)[63107]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: mssql_validate
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: mssql_monitor
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:04 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:04 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:52:04  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:04 Connected to the instance at localhost:1433
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 Monitor Caller is: monitor.
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 Replica is RESOLVING (0)
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 Instance name is server3.
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 Current master is server2.
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 Setting the role to Secondary.
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 Setting replica to SECONDARY role...
>Jul 19 14:52:09  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:09 Replica is RESOLVING (0)
>Jul 19 14:52:10  ag(ag_cluster)[63200]:    INFO: monitor: 2023/07/19 14:52:10 Replica is SECONDARY (2)
>Jul 19 14:52:10  ag(ag_cluster)[63200]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:52:10  ag(ag_cluster)[63200]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:52:10  ag(ag_cluster)[63200]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:52:10  ag(ag_cluster)[63200]:    INFO: ag_cluster monitor : 0
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: mssql_validate
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: mssql_monitor
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:10 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:10 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:10 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:52:10  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:10 Connected to the instance at localhost:1433
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:15 Monitor Caller is: monitor.
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:15 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:15 Replica is SECONDARY (2)
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:15 Instance name is server3.
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: monitor: 2023/07/19 14:52:15 Current master is server2.
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:52:15  ag(ag_cluster)[63380]:    INFO: ag_cluster monitor : 0
>Jul 19 14:52:17  ag(ag_cluster)[63534]:    INFO: mssql_validate
>Jul 19 14:52:17  ag(ag_cluster)[63534]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:17  ag(ag_cluster)[63534]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:17  ag(ag_cluster)[63534]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:17  ag(ag_cluster)[63534]:    INFO: mssql_notify pre-stop
>Jul 19 14:52:17  ag(ag_cluster)[63534]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:17  ag(ag_cluster)[63579]:    INFO: mssql_validate
>Jul 19 14:52:17  ag(ag_cluster)[63579]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:17  ag(ag_cluster)[63579]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:17  ag(ag_cluster)[63579]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:17  ag(ag_cluster)[63579]:    INFO: mssql_notify pre-stop
>Jul 19 14:52:17  ag(ag_cluster)[63579]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: mssql_validate
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: Resource agent invoked with: stop
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: mssql_stop
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: stop: 2023/07/19 14:52:17 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: stop: 2023/07/19 14:52:17 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: stop: 2023/07/19 14:52:17 Replica is SECONDARY (2)
>Jul 19 14:52:17  ag(ag_cluster)[63624]:    INFO: ag_cluster stop : 0
>Jul 19 14:52:38  ag(ag_cluster)[63707]:    INFO: mssql_validate
>Jul 19 14:52:38  ag(ag_cluster)[63707]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:38  ag(ag_cluster)[63707]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:38  ag(ag_cluster)[63707]:    INFO: Resource agent invoked with: start
>Jul 19 14:52:38  ag(ag_cluster)[63707]:    INFO: mssql_start
>Jul 19 14:52:39  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:39 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:52:39  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:39 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:52:39  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:39 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:52:39  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:39 Connected to the instance at localhost:1433
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Replica is SECONDARY (2)
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Sequence number is 3850:B (61916248539147)
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Line does not match expected syntax. Ignoring.
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Line does not match expected syntax. Ignoring.
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61916248539147"]
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 1 sequence numbers were found
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Max sequence number is 3850:B (61916248539147)
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Monitor Caller is: start.
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Replica is SECONDARY (2)
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Instance name is server3.
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: 2023/07/19 14:52:44 Current master is server2.
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:52:44  ag(ag_cluster)[63707]:    INFO: ag_cluster start : 0
>Jul 19 14:52:44  ag(ag_cluster)[63904]:    INFO: mssql_validate
>Jul 19 14:52:44  ag(ag_cluster)[63904]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:44  ag(ag_cluster)[63904]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:44  ag(ag_cluster)[63904]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:44  ag(ag_cluster)[63904]:    INFO: mssql_notify post-start
>Jul 19 14:52:44  ag(ag_cluster)[63904]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:45  ag(ag_cluster)[63952]:    INFO: mssql_validate
>Jul 19 14:52:45  ag(ag_cluster)[63952]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:45  ag(ag_cluster)[63952]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:45  ag(ag_cluster)[63952]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:45  ag(ag_cluster)[63952]:    INFO: mssql_notify pre-demote
>Jul 19 14:52:45  ag(ag_cluster)[63952]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:45  ag(ag_cluster)[64003]:    INFO: mssql_validate
>Jul 19 14:52:45  ag(ag_cluster)[64003]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:45  ag(ag_cluster)[64003]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:45  ag(ag_cluster)[64003]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:45  ag(ag_cluster)[64003]:    INFO: mssql_notify post-demote
>Jul 19 14:52:45  ag(ag_cluster)[64003]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:45  ag(ag_cluster)[64048]:    INFO: mssql_validate
>Jul 19 14:52:45  ag(ag_cluster)[64048]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:45  ag(ag_cluster)[64048]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:45  ag(ag_cluster)[64048]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:45  ag(ag_cluster)[64048]:    INFO: mssql_notify pre-stop
>Jul 19 14:52:45  ag(ag_cluster)[64048]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: mssql_validate
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: mssql_notify post-stop
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: notify: 2023/07/19 14:52:46 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: notify: 2023/07/19 14:52:46 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: notify: 2023/07/19 14:52:46 Replica is SECONDARY (2)
>Jul 19 14:52:46  ag(ag_cluster)[64093]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: mssql_validate
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: mssql_notify pre-start
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: notify: 2023/07/19 14:52:46 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: notify: 2023/07/19 14:52:46 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: notify: 2023/07/19 14:52:46 Replica is SECONDARY (2)
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: notify: 2023/07/19 14:52:46 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: notify: 2023/07/19 14:52:46 Sequence number is 3850:B (61916248539147)
>Jul 19 14:52:46  ag(ag_cluster)[64167]:    INFO: notify: SEQUENCE_NUMBER: 61916248539147
>Jul 19 14:52:51  ag(ag_cluster)[64167]:    INFO: ag_cluster notify : 0
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: mssql_validate
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: Resource agent invoked with: notify
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: mssql_notify pre-start
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: notify: 2023/07/19 14:52:51 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: notify: 2023/07/19 14:52:51 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: notify: 2023/07/19 14:52:51 Replica is SECONDARY (2)
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: notify: 2023/07/19 14:52:51 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: notify: 2023/07/19 14:52:51 Sequence number is 3850:B (61916248539147)
>Jul 19 14:52:51  ag(ag_cluster)[64267]:    INFO: notify: SEQUENCE_NUMBER: 61916248539147
>Jul 19 14:52:56  ag(ag_cluster)[64267]:    INFO: ag_cluster notify : 0
>Jul 19 14:53:02  ag(ag_cluster)[64367]:    INFO: mssql_validate
>Jul 19 14:53:02  ag(ag_cluster)[64367]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:53:02  ag(ag_cluster)[64367]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:02  ag(ag_cluster)[64367]:    INFO: Resource agent invoked with: notify
>Jul 19 14:53:02  ag(ag_cluster)[64367]:    INFO: mssql_notify post-start
>Jul 19 14:53:02  ag(ag_cluster)[64367]:    INFO: ag_cluster notify : 0
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: mssql_validate
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: Resource agent invoked with: notify
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: mssql_notify pre-promote
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: notify: 2023/07/19 14:53:02 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: notify: 2023/07/19 14:53:02 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:53:02  ag(ag_cluster)[64413]:    INFO: notify: 2023/07/19 14:53:02 Connected to the instance at localhost:1433
>Jul 19 14:53:07  ag(ag_cluster)[64413]:    INFO: notify: 2023/07/19 14:53:07 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:53:07  ag(ag_cluster)[64413]:    INFO: notify: 2023/07/19 14:53:07 Sequence number is 3850:B (61916248539147)
>Jul 19 14:53:07  ag(ag_cluster)[64413]:    INFO: notify: SEQUENCE_NUMBER: 61916248539147
>Jul 19 14:53:13  ag(ag_cluster)[64413]:    INFO: ag_cluster notify : 0
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: mssql_validate
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: Resource agent invoked with: notify
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: mssql_notify pre-promote
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: notify: 2023/07/19 14:53:13 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: notify: 2023/07/19 14:53:13 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:53:13  ag(ag_cluster)[64518]:    INFO: notify: 2023/07/19 14:53:13 Connected to the instance at localhost:1433
>Jul 19 14:53:18  ag(ag_cluster)[64518]:    INFO: notify: 2023/07/19 14:53:18 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:53:18  ag(ag_cluster)[64518]:    INFO: notify: 2023/07/19 14:53:18 Sequence number is 3850:B (61916248539147)
>Jul 19 14:53:18  ag(ag_cluster)[64518]:    INFO: notify: SEQUENCE_NUMBER: 61916248539147
>Jul 19 14:53:23  ag(ag_cluster)[64518]:    INFO: ag_cluster notify : 0
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: mssql_validate
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: Resource agent invoked with: notify
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: mssql_notify post-promote
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: notify: 2023/07/19 14:53:29 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: notify: 2023/07/19 14:53:29 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: notify: 2023/07/19 14:53:29 Replica is SECONDARY (2)
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: notify: 2023/07/19 14:53:29 Setting secondary to offline
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: notify: 2023/07/19 14:53:29 Offlining replica...
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: notify: 2023/07/19 14:53:29 Replica is RESOLVING (0)
>Jul 19 14:53:29  ag(ag_cluster)[64623]:    INFO: ag_cluster notify : 0
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: mssql_validate
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: mssql_monitor
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:29 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:29 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:29 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:53:29  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:29 Connected to the instance at localhost:1433
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 Monitor Caller is: monitor.
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 Replica is RESOLVING (0)
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 Instance name is server3.
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 Current master is server2.
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 Setting the role to Secondary.
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 Setting replica to SECONDARY role...
>Jul 19 14:53:34  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:34 Replica is RESOLVING (0)
>Jul 19 14:53:35  ag(ag_cluster)[64717]:    INFO: monitor: 2023/07/19 14:53:35 Replica is SECONDARY (2)
>Jul 19 14:53:35  ag(ag_cluster)[64717]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:53:35  ag(ag_cluster)[64717]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:53:35  ag(ag_cluster)[64717]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:53:35  ag(ag_cluster)[64717]:    INFO: ag_cluster monitor : 0
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: mssql_validate
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: mssql_monitor
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:35 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:35 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:35 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:53:35  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:35 Connected to the instance at localhost:1433
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:40 Monitor Caller is: monitor.
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:40 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:40 Replica is SECONDARY (2)
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:40 Instance name is server3.
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: monitor: 2023/07/19 14:53:40 Current master is server2.
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:53:40  ag(ag_cluster)[64894]:    INFO: ag_cluster monitor : 0
>Jul 19 14:53:41  ag(ag_cluster)[65049]:    INFO: mssql_validate
>Jul 19 14:53:41  ag(ag_cluster)[65049]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:53:41  ag(ag_cluster)[65049]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:41  ag(ag_cluster)[65049]:    INFO: Resource agent invoked with: notify
>Jul 19 14:53:41  ag(ag_cluster)[65049]:    INFO: mssql_notify pre-stop
>Jul 19 14:53:41  ag(ag_cluster)[65049]:    INFO: ag_cluster notify : 0
>Jul 19 14:53:41  ag(ag_cluster)[65094]:    INFO: mssql_validate
>Jul 19 14:53:41  ag(ag_cluster)[65094]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:53:41  ag(ag_cluster)[65094]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:53:41  ag(ag_cluster)[65094]:    INFO: Resource agent invoked with: notify
>Jul 19 14:53:41  ag(ag_cluster)[65094]:    INFO: mssql_notify pre-stop
>Jul 19 14:53:41  ag(ag_cluster)[65094]:    INFO: ag_cluster notify : 0
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: mssql_validate
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: Resource agent invoked with: stop
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: mssql_stop
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: stop: 2023/07/19 14:53:41 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: stop: 2023/07/19 14:53:41 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: stop: 2023/07/19 14:53:41 Replica is SECONDARY (2)
>Jul 19 14:53:41  ag(ag_cluster)[65139]:    INFO: ag_cluster stop : 0
>Jul 19 14:54:02  ag(ag_cluster)[65232]:    INFO: mssql_validate
>Jul 19 14:54:02  ag(ag_cluster)[65232]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:02  ag(ag_cluster)[65232]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:02  ag(ag_cluster)[65232]:    INFO: Resource agent invoked with: start
>Jul 19 14:54:02  ag(ag_cluster)[65232]:    INFO: mssql_start
>Jul 19 14:54:02  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:02 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:54:03  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:02 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:54:03  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:02 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:54:03  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:03 Connected to the instance at localhost:1433
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Replica is SECONDARY (2)
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Sequence number is 3851:7 (61920543506439)
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Line does not match expected syntax. Ignoring.
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Line does not match expected syntax. Ignoring.
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61920543506439"]
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 1 sequence numbers were found
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Max sequence number is 3851:7 (61920543506439)
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Monitor Caller is: start.
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Replica is SECONDARY (2)
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Instance name is server3.
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: 2023/07/19 14:54:08 Current master is server2.
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:54:08  ag(ag_cluster)[65232]:    INFO: ag_cluster start : 0
>Jul 19 14:54:08  ag(ag_cluster)[65430]:    INFO: mssql_validate
>Jul 19 14:54:08  ag(ag_cluster)[65430]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:08  ag(ag_cluster)[65430]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:08  ag(ag_cluster)[65430]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:08  ag(ag_cluster)[65430]:    INFO: mssql_notify post-start
>Jul 19 14:54:08  ag(ag_cluster)[65430]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:09  ag(ag_cluster)[65476]:    INFO: mssql_validate
>Jul 19 14:54:09  ag(ag_cluster)[65476]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:09  ag(ag_cluster)[65476]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:09  ag(ag_cluster)[65476]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:09  ag(ag_cluster)[65476]:    INFO: mssql_notify pre-demote
>Jul 19 14:54:09  ag(ag_cluster)[65476]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:09  ag(ag_cluster)[65521]:    INFO: mssql_validate
>Jul 19 14:54:09  ag(ag_cluster)[65521]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:09  ag(ag_cluster)[65521]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:09  ag(ag_cluster)[65521]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:09  ag(ag_cluster)[65521]:    INFO: mssql_notify post-demote
>Jul 19 14:54:09  ag(ag_cluster)[65521]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:09  ag(ag_cluster)[65566]:    INFO: mssql_validate
>Jul 19 14:54:09  ag(ag_cluster)[65566]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:09  ag(ag_cluster)[65566]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:09  ag(ag_cluster)[65566]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:09  ag(ag_cluster)[65566]:    INFO: mssql_notify pre-stop
>Jul 19 14:54:09  ag(ag_cluster)[65566]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:09  ag(ag_cluster)[65611]:    INFO: mssql_validate
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: mssql_notify post-stop
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: notify: 2023/07/19 14:54:10 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: notify: 2023/07/19 14:54:10 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: notify: 2023/07/19 14:54:10 Replica is SECONDARY (2)
>Jul 19 14:54:10  ag(ag_cluster)[65611]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: mssql_validate
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: mssql_notify pre-start
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: notify: 2023/07/19 14:54:10 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: notify: 2023/07/19 14:54:10 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: notify: 2023/07/19 14:54:10 Replica is SECONDARY (2)
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: notify: 2023/07/19 14:54:10 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: notify: 2023/07/19 14:54:10 Sequence number is 3851:7 (61920543506439)
>Jul 19 14:54:10  ag(ag_cluster)[65686]:    INFO: notify: SEQUENCE_NUMBER: 61920543506439
>Jul 19 14:54:15  ag(ag_cluster)[65686]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: mssql_validate
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: mssql_notify pre-start
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: notify: 2023/07/19 14:54:15 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: notify: 2023/07/19 14:54:15 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: notify: 2023/07/19 14:54:15 Replica is SECONDARY (2)
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: notify: 2023/07/19 14:54:15 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: notify: 2023/07/19 14:54:15 Sequence number is 3851:7 (61920543506439)
>Jul 19 14:54:15  ag(ag_cluster)[65784]:    INFO: notify: SEQUENCE_NUMBER: 61920543506439
>Jul 19 14:54:20  ag(ag_cluster)[65784]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:26  ag(ag_cluster)[65885]:    INFO: mssql_validate
>Jul 19 14:54:26  ag(ag_cluster)[65885]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:26  ag(ag_cluster)[65885]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:26  ag(ag_cluster)[65885]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:26  ag(ag_cluster)[65885]:    INFO: mssql_notify post-start
>Jul 19 14:54:26  ag(ag_cluster)[65885]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: mssql_validate
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: mssql_notify pre-promote
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: notify: 2023/07/19 14:54:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: notify: 2023/07/19 14:54:26 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:54:26  ag(ag_cluster)[65931]:    INFO: notify: 2023/07/19 14:54:26 Connected to the instance at localhost:1433
>Jul 19 14:54:31  ag(ag_cluster)[65931]:    INFO: notify: 2023/07/19 14:54:31 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:54:31  ag(ag_cluster)[65931]:    INFO: notify: 2023/07/19 14:54:31 Sequence number is 3851:7 (61920543506439)
>Jul 19 14:54:31  ag(ag_cluster)[65931]:    INFO: notify: SEQUENCE_NUMBER: 61920543506439
>Jul 19 14:54:36  ag(ag_cluster)[65931]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: mssql_validate
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: mssql_notify pre-promote
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: notify: 2023/07/19 14:54:36 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: notify: 2023/07/19 14:54:36 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:54:36  ag(ag_cluster)[66034]:    INFO: notify: 2023/07/19 14:54:36 Connected to the instance at localhost:1433
>Jul 19 14:54:41  ag(ag_cluster)[66034]:    INFO: notify: 2023/07/19 14:54:41 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:54:41  ag(ag_cluster)[66034]:    INFO: notify: 2023/07/19 14:54:41 Sequence number is 3851:7 (61920543506439)
>Jul 19 14:54:41  ag(ag_cluster)[66034]:    INFO: notify: SEQUENCE_NUMBER: 61920543506439
>Jul 19 14:54:46  ag(ag_cluster)[66034]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: mssql_validate
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: Resource agent invoked with: notify
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: mssql_notify post-promote
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: notify: 2023/07/19 14:54:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: notify: 2023/07/19 14:54:52 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: notify: 2023/07/19 14:54:52 Replica is SECONDARY (2)
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: notify: 2023/07/19 14:54:52 Setting secondary to offline
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: notify: 2023/07/19 14:54:52 Offlining replica...
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: notify: 2023/07/19 14:54:52 Replica is RESOLVING (0)
>Jul 19 14:54:52  ag(ag_cluster)[66147]:    INFO: ag_cluster notify : 0
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: mssql_validate
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: mssql_monitor
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:52 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:52 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:52 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:54:52  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:52 Connected to the instance at localhost:1433
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 Monitor Caller is: monitor.
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 Replica is RESOLVING (0)
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 Instance name is server3.
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 Current master is server2.
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 Setting the role to Secondary.
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 Setting replica to SECONDARY role...
>Jul 19 14:54:57  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:57 Replica is RESOLVING (0)
>Jul 19 14:54:58  ag(ag_cluster)[66241]:    INFO: monitor: 2023/07/19 14:54:58 Replica is SECONDARY (2)
>Jul 19 14:54:58  ag(ag_cluster)[66241]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:54:58  ag(ag_cluster)[66241]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:54:58  ag(ag_cluster)[66241]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:54:58  ag(ag_cluster)[66241]:    INFO: ag_cluster monitor : 0
>Jul 19 14:54:58  ag(ag_cluster)[66420]:    INFO: mssql_validate
>Jul 19 14:54:58  ag(ag_cluster)[66420]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:54:58  ag(ag_cluster)[66420]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:54:58  ag(ag_cluster)[66420]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:54:59  ag(ag_cluster)[66420]:    INFO: mssql_monitor
>Jul 19 14:54:59  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:54:59 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:54:59  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:54:59 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:54:59  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:54:59 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:54:59  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:54:59 Connected to the instance at localhost:1433
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:55:04 Monitor Caller is: monitor.
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:55:04 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:55:04 Replica is SECONDARY (2)
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:55:04 Instance name is server3.
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: monitor: 2023/07/19 14:55:04 Current master is server2.
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:55:04  ag(ag_cluster)[66420]:    INFO: ag_cluster monitor : 0
>Jul 19 14:55:04  ag(ag_cluster)[66577]:    INFO: mssql_validate
>Jul 19 14:55:04  ag(ag_cluster)[66577]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:04  ag(ag_cluster)[66577]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:04  ag(ag_cluster)[66577]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:04  ag(ag_cluster)[66577]:    INFO: mssql_notify pre-stop
>Jul 19 14:55:04  ag(ag_cluster)[66577]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:04  ag(ag_cluster)[66622]:    INFO: mssql_validate
>Jul 19 14:55:04  ag(ag_cluster)[66622]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:04  ag(ag_cluster)[66622]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:04  ag(ag_cluster)[66622]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:04  ag(ag_cluster)[66622]:    INFO: mssql_notify pre-stop
>Jul 19 14:55:04  ag(ag_cluster)[66622]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: mssql_validate
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: Resource agent invoked with: stop
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: mssql_stop
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: stop: 2023/07/19 14:55:04 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: stop: 2023/07/19 14:55:04 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: stop: 2023/07/19 14:55:04 Replica is SECONDARY (2)
>Jul 19 14:55:04  ag(ag_cluster)[66667]:    INFO: ag_cluster stop : 0
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: mssql_validate
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: Resource agent invoked with: start
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: mssql_start
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:26 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:26 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:26 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:55:26  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:26 Connected to the instance at localhost:1433
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Replica is SECONDARY (2)
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Sequence number is 3852:B (61924838473739)
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Line does not match expected syntax. Ignoring.
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Line does not match expected syntax. Ignoring.
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61924838473739"]
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 1 sequence numbers were found
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Max sequence number is 3852:B (61924838473739)
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Monitor Caller is: start.
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Replica is SECONDARY (2)
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Instance name is server3.
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: 2023/07/19 14:55:31 Current master is server2.
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:55:31  ag(ag_cluster)[66751]:    INFO: ag_cluster start : 0
>Jul 19 14:55:31  ag(ag_cluster)[66948]:    INFO: mssql_validate
>Jul 19 14:55:31  ag(ag_cluster)[66948]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:31  ag(ag_cluster)[66948]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:31  ag(ag_cluster)[66948]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:31  ag(ag_cluster)[66948]:    INFO: mssql_notify post-start
>Jul 19 14:55:31  ag(ag_cluster)[66948]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:32  ag(ag_cluster)[66994]:    INFO: mssql_validate
>Jul 19 14:55:32  ag(ag_cluster)[66994]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:32  ag(ag_cluster)[66994]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:32  ag(ag_cluster)[66994]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:32  ag(ag_cluster)[66994]:    INFO: mssql_notify pre-demote
>Jul 19 14:55:32  ag(ag_cluster)[66994]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:32  ag(ag_cluster)[67039]:    INFO: mssql_validate
>Jul 19 14:55:32  ag(ag_cluster)[67039]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:32  ag(ag_cluster)[67039]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:32  ag(ag_cluster)[67039]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:32  ag(ag_cluster)[67039]:    INFO: mssql_notify post-demote
>Jul 19 14:55:32  ag(ag_cluster)[67039]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:32  ag(ag_cluster)[67084]:    INFO: mssql_validate
>Jul 19 14:55:32  ag(ag_cluster)[67084]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:32  ag(ag_cluster)[67084]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:32  ag(ag_cluster)[67084]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:32  ag(ag_cluster)[67084]:    INFO: mssql_notify pre-stop
>Jul 19 14:55:32  ag(ag_cluster)[67084]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: mssql_validate
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: mssql_notify post-stop
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: notify: 2023/07/19 14:55:32 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: notify: 2023/07/19 14:55:32 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: notify: 2023/07/19 14:55:32 Replica is SECONDARY (2)
>Jul 19 14:55:32  ag(ag_cluster)[67129]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: mssql_validate
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: mssql_notify pre-start
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: notify: 2023/07/19 14:55:32 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: notify: 2023/07/19 14:55:32 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: notify: 2023/07/19 14:55:32 Replica is SECONDARY (2)
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: notify: 2023/07/19 14:55:32 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: notify: 2023/07/19 14:55:32 Sequence number is 3852:B (61924838473739)
>Jul 19 14:55:32  ag(ag_cluster)[67204]:    INFO: notify: SEQUENCE_NUMBER: 61924838473739
>Jul 19 14:55:37  ag(ag_cluster)[67204]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: mssql_validate
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: mssql_notify pre-start
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: notify: 2023/07/19 14:55:38 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: notify: 2023/07/19 14:55:38 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: notify: 2023/07/19 14:55:38 Replica is SECONDARY (2)
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: notify: 2023/07/19 14:55:38 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: notify: 2023/07/19 14:55:38 Sequence number is 3852:B (61924838473739)
>Jul 19 14:55:38  ag(ag_cluster)[67303]:    INFO: notify: SEQUENCE_NUMBER: 61924838473739
>Jul 19 14:55:43  ag(ag_cluster)[67303]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:48  ag(ag_cluster)[67411]:    INFO: mssql_validate
>Jul 19 14:55:48  ag(ag_cluster)[67411]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:48  ag(ag_cluster)[67411]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:48  ag(ag_cluster)[67411]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:48  ag(ag_cluster)[67411]:    INFO: mssql_notify post-start
>Jul 19 14:55:48  ag(ag_cluster)[67411]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: mssql_validate
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: mssql_notify pre-promote
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: notify: 2023/07/19 14:55:48 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: notify: 2023/07/19 14:55:48 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:55:48  ag(ag_cluster)[67457]:    INFO: notify: 2023/07/19 14:55:48 Connected to the instance at localhost:1433
>Jul 19 14:55:53  ag(ag_cluster)[67457]:    INFO: notify: 2023/07/19 14:55:53 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:55:53  ag(ag_cluster)[67457]:    INFO: notify: 2023/07/19 14:55:53 Sequence number is 3852:B (61924838473739)
>Jul 19 14:55:53  ag(ag_cluster)[67457]:    INFO: notify: SEQUENCE_NUMBER: 61924838473739
>Jul 19 14:55:58  ag(ag_cluster)[67457]:    INFO: ag_cluster notify : 0
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: mssql_validate
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: Resource agent invoked with: notify
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: mssql_notify pre-promote
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: notify: 2023/07/19 14:55:58 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: notify: 2023/07/19 14:55:58 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:55:58  ag(ag_cluster)[67562]:    INFO: notify: 2023/07/19 14:55:58 Connected to the instance at localhost:1433
>Jul 19 14:56:03  ag(ag_cluster)[67562]:    INFO: notify: 2023/07/19 14:56:03 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:56:03  ag(ag_cluster)[67562]:    INFO: notify: 2023/07/19 14:56:03 Sequence number is 3852:B (61924838473739)
>Jul 19 14:56:04  ag(ag_cluster)[67562]:    INFO: notify: SEQUENCE_NUMBER: 61924838473739
>Jul 19 14:56:09  ag(ag_cluster)[67562]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: mssql_validate
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: mssql_notify post-promote
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: notify: 2023/07/19 14:56:14 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-promote]; connection-timeout [30]; health-threshold [3]; action [post-promote]
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: notify: 2023/07/19 14:56:14 [DEBUG] AG Helper PostPromote Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: notify: 2023/07/19 14:56:14 Replica is SECONDARY (2)
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: notify: 2023/07/19 14:56:14 Setting secondary to offline
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: notify: 2023/07/19 14:56:14 Offlining replica...
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: notify: 2023/07/19 14:56:14 Replica is RESOLVING (0)
>Jul 19 14:56:14  ag(ag_cluster)[67666]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: mssql_validate
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: OCF_RESKEY_CRM_meta_interval value: 12000
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: mssql_monitor
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:14 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:14 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [74]; monitor-interval-timeout [60]
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:14 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:56:14  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:14 Connected to the instance at localhost:1433
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 Monitor Caller is: monitor.
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 Replica is RESOLVING (0)
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 Instance name is server3.
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 Current master is server2.
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 Setting the role to Secondary.
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 Setting replica to SECONDARY role...
>Jul 19 14:56:19  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:19 Replica is RESOLVING (0)
>Jul 19 14:56:20  ag(ag_cluster)[67761]:    INFO: monitor: 2023/07/19 14:56:20 Replica is SECONDARY (2)
>Jul 19 14:56:20  ag(ag_cluster)[67761]:    INFO: monitor: PROMOTION_SCORE: -INFINITY
>Jul 19 14:56:20  ag(ag_cluster)[67761]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:56:20  ag(ag_cluster)[67761]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:56:20  ag(ag_cluster)[67761]:    INFO: ag_cluster monitor : 0
>Jul 19 14:56:20  ag(ag_cluster)[67940]:    INFO: mssql_validate
>Jul 19 14:56:20  ag(ag_cluster)[67940]:    INFO: OCF_RESKEY_CRM_meta_interval value: 10000
>Jul 19 14:56:20  ag(ag_cluster)[67940]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:20  ag(ag_cluster)[67940]:    INFO: Resource agent invoked with: monitor
>Jul 19 14:56:20  ag(ag_cluster)[67940]:    INFO: mssql_monitor
>Jul 19 14:56:21  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:21 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-monitor]; connection-timeout [30]; health-threshold [3]; action [monitor]
>Jul 19 14:56:21  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:21 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [72]; monitor-interval-timeout [60]
>Jul 19 14:56:21  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:21 From RetryExecuteWithTimeout - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:56:21  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:21 Connected to the instance at localhost:1433
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:26 Monitor Caller is: monitor.
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:26 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:26 Replica is SECONDARY (2)
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:26 Instance name is server3.
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: monitor: 2023/07/19 14:56:26 Current master is server2.
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: monitor: PROMOTION_SCORE: 10
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: lease_expiry after monitor update: 
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: lease information from all replicas after monitor update: name="ag_cluster-lease-expiry" host="server1" value=""
>name="ag_cluster-lease-expiry" host="server3" value=""
>name="ag_cluster-lease-expiry" host="server2" value=""
>Jul 19 14:56:26  ag(ag_cluster)[67940]:    INFO: ag_cluster monitor : 0
>Jul 19 14:56:27  ag(ag_cluster)[68095]:    INFO: mssql_validate
>Jul 19 14:56:27  ag(ag_cluster)[68095]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:27  ag(ag_cluster)[68095]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:27  ag(ag_cluster)[68095]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:27  ag(ag_cluster)[68095]:    INFO: mssql_notify pre-stop
>Jul 19 14:56:27  ag(ag_cluster)[68095]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:27  ag(ag_cluster)[68140]:    INFO: mssql_validate
>Jul 19 14:56:27  ag(ag_cluster)[68140]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:27  ag(ag_cluster)[68140]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:27  ag(ag_cluster)[68140]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:27  ag(ag_cluster)[68140]:    INFO: mssql_notify pre-stop
>Jul 19 14:56:27  ag(ag_cluster)[68140]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: mssql_validate
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 10000
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: Resource agent invoked with: stop
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: mssql_stop
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: stop: 2023/07/19 14:56:27 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-stop]; connection-timeout [30]; health-threshold [3]; action [stop]
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: stop: 2023/07/19 14:56:27 [DEBUG] AG Helper Stop Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: stop: 2023/07/19 14:56:27 Replica is SECONDARY (2)
>Jul 19 14:56:27  ag(ag_cluster)[68185]:    INFO: ag_cluster stop : 0
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: mssql_validate
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: Resource agent invoked with: start
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: mssql_start
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:49 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-start]; connection-timeout [30]; health-threshold [3]; action [start]
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:49 ag-helper invoked with sequence-numbers [...]; required-synchronized-secondaries-to-commit [-1]; current-master [server2]; disable-primary-on-quorum-timeout-after [60]; primary-write-lease-duration [62]
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:49 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:56:49  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:49 Connected to the instance at localhost:1433
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 [DEBUG] AG Helper Start Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Replica is SECONDARY (2)
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Sequence number is 3853:B (61929133441035)
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Verifying replica's sequence number vs all sequence numbers...
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Sequence number line [name="ag_cluster-sequence-number" host="server1" value=""]
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Line does not match expected syntax. Ignoring.
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Sequence number line [name="ag_cluster-sequence-number" host="server3" value=""]
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Line does not match expected syntax. Ignoring.
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Sequence number line [name="ag_cluster-sequence-number" host="server2" value="61929133441035"]
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 1 sequence numbers were found
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Max sequence number is 3853:B (61929133441035)
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Monitor Caller is: start.
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 [DEBUG] AG Helper Monitor Role info: AVAILABILITY GROUP ag1 on instance server3
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Replica is SECONDARY (2)
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Instance name is server3.
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: 2023/07/19 14:56:54 Current master is server2.
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: start: PROMOTION_SCORE: 10
>Jul 19 14:56:54  ag(ag_cluster)[68275]:    INFO: ag_cluster start : 0
>Jul 19 14:56:54  ag(ag_cluster)[68476]:    INFO: mssql_validate
>Jul 19 14:56:54  ag(ag_cluster)[68476]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:54  ag(ag_cluster)[68476]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:54  ag(ag_cluster)[68476]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:54  ag(ag_cluster)[68476]:    INFO: mssql_notify post-start
>Jul 19 14:56:54  ag(ag_cluster)[68476]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:55  ag(ag_cluster)[68522]:    INFO: mssql_validate
>Jul 19 14:56:55  ag(ag_cluster)[68522]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:55  ag(ag_cluster)[68522]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:55  ag(ag_cluster)[68522]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:55  ag(ag_cluster)[68522]:    INFO: mssql_notify pre-demote
>Jul 19 14:56:55  ag(ag_cluster)[68522]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:55  ag(ag_cluster)[68567]:    INFO: mssql_validate
>Jul 19 14:56:55  ag(ag_cluster)[68567]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:55  ag(ag_cluster)[68567]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:55  ag(ag_cluster)[68567]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:55  ag(ag_cluster)[68567]:    INFO: mssql_notify post-demote
>Jul 19 14:56:55  ag(ag_cluster)[68567]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:55  ag(ag_cluster)[68612]:    INFO: mssql_validate
>Jul 19 14:56:55  ag(ag_cluster)[68612]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:55  ag(ag_cluster)[68612]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:55  ag(ag_cluster)[68612]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:55  ag(ag_cluster)[68612]:    INFO: mssql_notify pre-stop
>Jul 19 14:56:55  ag(ag_cluster)[68612]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: mssql_validate
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: mssql_notify post-stop
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: notify: 2023/07/19 14:56:55 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-post-stop]; connection-timeout [30]; health-threshold [3]; action [post-stop]
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: notify: 2023/07/19 14:56:55 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: notify: 2023/07/19 14:56:55 Replica is SECONDARY (2)
>Jul 19 14:56:55  ag(ag_cluster)[68657]:    INFO: ag_cluster notify : 0
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: mssql_validate
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: Resource agent invoked with: notify
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: mssql_notify pre-start
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: notify: 2023/07/19 14:56:55 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: notify: 2023/07/19 14:56:55 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: notify: 2023/07/19 14:56:55 Replica is SECONDARY (2)
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: notify: 2023/07/19 14:56:55 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: notify: 2023/07/19 14:56:55 Sequence number is 3853:B (61929133441035)
>Jul 19 14:56:55  ag(ag_cluster)[68731]:    INFO: notify: SEQUENCE_NUMBER: 61929133441035
>Jul 19 14:57:00  ag(ag_cluster)[68731]:    INFO: ag_cluster notify : 0
>Jul 19 14:57:00  ag(ag_cluster)[68829]:    INFO: mssql_validate
>Jul 19 14:57:00  ag(ag_cluster)[68829]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:57:00  ag(ag_cluster)[68829]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:57:00  ag(ag_cluster)[68829]:    INFO: Resource agent invoked with: notify
>Jul 19 14:57:00  ag(ag_cluster)[68829]:    INFO: mssql_notify pre-start
>Jul 19 14:57:01  ag(ag_cluster)[68829]:    INFO: notify: 2023/07/19 14:57:01 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-start]; connection-timeout [30]; health-threshold [3]; action [pre-start]
>Jul 19 14:57:01  ag(ag_cluster)[68829]:    INFO: notify: 2023/07/19 14:57:01 ag-helper invoked with required-synchronized-secondaries-to-commit [-1]
>Jul 19 14:57:01  ag(ag_cluster)[68829]:    INFO: notify: 2023/07/19 14:57:01 Replica is SECONDARY (2)
>Jul 19 14:57:01  ag(ag_cluster)[68829]:    INFO: notify: 2023/07/19 14:57:01 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:57:01  ag(ag_cluster)[68829]:    INFO: notify: 2023/07/19 14:57:01 Sequence number is 3853:B (61929133441035)
>Jul 19 14:57:01  ag(ag_cluster)[68829]:    INFO: notify: SEQUENCE_NUMBER: 61929133441035
>Jul 19 14:57:06  ag(ag_cluster)[68829]:    INFO: ag_cluster notify : 0
>Jul 19 14:57:11  ag(ag_cluster)[68933]:    INFO: mssql_validate
>Jul 19 14:57:11  ag(ag_cluster)[68933]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:57:11  ag(ag_cluster)[68933]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:57:11  ag(ag_cluster)[68933]:    INFO: Resource agent invoked with: notify
>Jul 19 14:57:11  ag(ag_cluster)[68933]:    INFO: mssql_notify post-start
>Jul 19 14:57:11  ag(ag_cluster)[68933]:    INFO: ag_cluster notify : 0
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: mssql_validate
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: OCF_RESKEY_CRM_meta_interval value: 0
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: OCF_RESKEY_CRM_meta_timeout value: 60000
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: Resource agent invoked with: notify
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: mssql_notify pre-promote
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: notify: 2023/07/19 14:57:11 ag-helper invoked with hostname [localhost]; port [1433]; ag-name [ag1]; credentials-file [/var/opt/mssql/secrets/passwd]; application-name [monitor-ag_cluster-pre-promote]; connection-timeout [30]; health-threshold [3]; action [pre-promote]
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: notify: 2023/07/19 14:57:11 From RetryExecute - Attempt 1 to connect to the instance at localhost:1433
>Jul 19 14:57:11  ag(ag_cluster)[68979]:    INFO: notify: 2023/07/19 14:57:11 Connected to the instance at localhost:1433
>Jul 19 14:57:16  ag(ag_cluster)[68979]:    INFO: notify: 2023/07/19 14:57:16 Replica is SYNCHRONOUS_COMMIT (1).
>Jul 19 14:57:16  ag(ag_cluster)[68979]:    INFO: notify: 2023/07/19 14:57:16 Sequence number is 3853:B (61929133441035)
>Jul 19 14:57:16  ag(ag_cluster)[68979]:    INFO: notify: SEQUENCE_NUMBER: 61929133441035

Actions: View

Attachments on bug 2221772: 1976118 | 1976119 | 1976120 | 1976684 | 1976685 | 1976686