Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 1480065 Details for
Bug 1624341
All OSDs down after OSP FFU
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
ceph-ansible-logs
ceph-install-workflow.log (text/plain), 1.80 MB, created by
Gregory Charot
on 2018-08-31 09:26:50 UTC
(
hide
)
Description:
ceph-ansible-logs
Filename:
MIME Type:
Creator:
Gregory Charot
Created:
2018-08-31 09:26:50 UTC
Size:
1.80 MB
patch
obsolete
>2018-08-30 12:02:11,160 p=7972 u=mistral | [DEPRECATION WARNING]: The use of 'include' for tasks has been deprecated. Use >'import_tasks' for static inclusions or 'include_tasks' for dynamic inclusions. > This feature will be removed in a future release. Deprecation warnings can be >disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:02:11,161 p=7972 u=mistral | [DEPRECATION WARNING]: include is kept for backwards compatibility but usage is > discouraged. The module documentation details page may explain more about this > rationale.. This feature will be removed in a future release. Deprecation >warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:02:11,562 p=7972 u=mistral | [DEPRECATION WARNING]: The use of 'static' has been deprecated. Use >'import_tasks' for static inclusion, or 'include_tasks' for dynamic inclusion. >This feature will be removed in a future release. Deprecation warnings can be >disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:02:11,599 p=7972 u=mistral | [DEPRECATION WARNING]: docker is kept for backwards compatibility but usage is >discouraged. The module documentation details page may explain more about this >rationale.. This feature will be removed in a future release. Deprecation >warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:02:13,890 p=7972 u=mistral | PLAY [confirm whether user really meant to switch from non-containerized to containerized ceph daemons] *** >2018-08-30 12:02:13,905 p=7972 u=mistral | TASK [exit playbook, if user did not mean to switch from non-containerized to containerized daemons?] *** >2018-08-30 12:02:13,906 p=7972 u=mistral | Thursday 30 August 2018 12:02:13 -0400 (0:00:00.086) 0:00:00.086 ******* >2018-08-30 12:02:13,928 p=7972 u=mistral | skipping: [localhost] >2018-08-30 12:02:13,946 p=7972 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: mdss > >2018-08-30 12:02:13,947 p=7972 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: rgws > >2018-08-30 12:02:13,947 p=7972 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: rbdmirrors > >2018-08-30 12:02:13,948 p=7972 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: nfss > >2018-08-30 12:02:13,960 p=7972 u=mistral | PLAY [make sure docker is present and started] ********************************* >2018-08-30 12:02:13,974 p=7972 u=mistral | TASK [Gathering Facts] ********************************************************* >2018-08-30 12:02:13,974 p=7972 u=mistral | Thursday 30 August 2018 12:02:13 -0400 (0:00:00.068) 0:00:00.154 ******* >2018-08-30 12:02:19,431 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:02:19,756 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:02:19,882 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:02:20,629 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:02:21,123 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:02:21,230 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:02:21,403 p=7972 u=mistral | TASK [gather and delegate facts] *********************************************** >2018-08-30 12:02:21,404 p=7972 u=mistral | Thursday 30 August 2018 12:02:21 -0400 (0:00:07.429) 0:00:07.584 ******* >2018-08-30 12:02:31,403 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:02:31,795 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:02:31,948 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:02:32,118 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:02:32,248 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:02:32,337 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:02:40,025 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:02:41,287 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:02:42,109 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:02:42,199 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:02:42,328 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:02:42,427 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:02:49,903 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:02:50,532 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:02:51,331 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:02:51,510 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:02:51,618 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:02:51,804 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:02:58,034 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.22] => (item=172.16.0.22) >2018-08-30 12:02:58,184 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.22] => (item=172.16.0.22) >2018-08-30 12:02:58,461 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.22] => (item=172.16.0.22) >2018-08-30 12:02:58,603 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.22] => (item=172.16.0.22) >2018-08-30 12:02:58,796 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.22] => (item=172.16.0.22) >2018-08-30 12:02:58,982 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.22] => (item=172.16.0.22) >2018-08-30 12:03:04,508 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.31] => (item=172.16.0.31) >2018-08-30 12:03:05,276 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.31] => (item=172.16.0.31) >2018-08-30 12:03:05,378 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.31] => (item=172.16.0.31) >2018-08-30 12:03:05,469 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.31] => (item=172.16.0.31) >2018-08-30 12:03:05,580 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.31] => (item=172.16.0.31) >2018-08-30 12:03:05,679 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.31] => (item=172.16.0.31) >2018-08-30 12:03:10,464 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:03:11,095 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:03:11,220 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:03:11,307 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:03:11,378 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:03:11,448 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:03:16,654 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:03:17,080 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:03:17,190 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:03:17,301 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:03:17,374 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:03:17,445 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:03:22,788 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:03:24,363 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:03:24,452 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:03:26,255 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:03:26,327 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:03:28,052 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:03:29,042 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph mon] ************** >2018-08-30 12:03:29,147 p=7972 u=mistral | TASK [select a running monitor] ************************************************ >2018-08-30 12:03:29,148 p=7972 u=mistral | Thursday 30 August 2018 12:03:29 -0400 (0:01:07.744) 0:01:15.328 ******* >2018-08-30 12:03:29,194 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:03:29,231 p=7972 u=mistral | ok: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:03:29,402 p=7972 u=mistral | ok: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:03:29,416 p=7972 u=mistral | TASK [stop non-containerized ceph mon] ***************************************** >2018-08-30 12:03:29,417 p=7972 u=mistral | Thursday 30 August 2018 12:03:29 -0400 (0:00:00.268) 0:01:15.597 ******* >2018-08-30 12:03:30,329 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:03:30,345 p=7972 u=mistral | TASK [set_fact ceph_uid for ubuntu] ******************************************** >2018-08-30 12:03:30,345 p=7972 u=mistral | Thursday 30 August 2018 12:03:30 -0400 (0:00:00.928) 0:01:16.525 ******* >2018-08-30 12:03:30,370 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:30,385 p=7972 u=mistral | TASK [set_fact ceph_uid for red hat] ******************************************* >2018-08-30 12:03:30,385 p=7972 u=mistral | Thursday 30 August 2018 12:03:30 -0400 (0:00:00.040) 0:01:16.566 ******* >2018-08-30 12:03:30,415 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:30,429 p=7972 u=mistral | TASK [set_fact ceph_uid for rhel] ********************************************** >2018-08-30 12:03:30,429 p=7972 u=mistral | Thursday 30 August 2018 12:03:30 -0400 (0:00:00.043) 0:01:16.610 ******* >2018-08-30 12:03:30,492 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:30,512 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:03:30,512 p=7972 u=mistral | Thursday 30 August 2018 12:03:30 -0400 (0:00:00.082) 0:01:16.692 ******* >2018-08-30 12:03:31,169 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph) >2018-08-30 12:03:31,455 p=7972 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:03:31,469 p=7972 u=mistral | TASK [check for existing old leveldb file extension (ldb)] ********************* >2018-08-30 12:03:31,469 p=7972 u=mistral | Thursday 30 August 2018 12:03:31 -0400 (0:00:00.956) 0:01:17.649 ******* >2018-08-30 12:03:32,067 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:32,081 p=7972 u=mistral | TASK [rename leveldb extension from ldb to sst] ******************************** >2018-08-30 12:03:32,081 p=7972 u=mistral | Thursday 30 August 2018 12:03:32 -0400 (0:00:00.612) 0:01:18.261 ******* >2018-08-30 12:03:32,106 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:32,121 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:03:32,121 p=7972 u=mistral | Thursday 30 August 2018 12:03:32 -0400 (0:00:00.039) 0:01:18.301 ******* >2018-08-30 12:03:32,634 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:32,648 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:03:32,649 p=7972 u=mistral | Thursday 30 August 2018 12:03:32 -0400 (0:00:00.527) 0:01:18.829 ******* >2018-08-30 12:03:32,680 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:32,695 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:03:32,695 p=7972 u=mistral | Thursday 30 August 2018 12:03:32 -0400 (0:00:00.046) 0:01:18.875 ******* >2018-08-30 12:03:32,725 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:32,740 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:03:32,740 p=7972 u=mistral | Thursday 30 August 2018 12:03:32 -0400 (0:00:00.044) 0:01:18.920 ******* >2018-08-30 12:03:32,769 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:32,784 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:03:32,784 p=7972 u=mistral | Thursday 30 August 2018 12:03:32 -0400 (0:00:00.043) 0:01:18.964 ******* >2018-08-30 12:03:33,309 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:33,324 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:03:33,324 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.540) 0:01:19.504 ******* >2018-08-30 12:03:33,358 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,376 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:03:33,376 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.052) 0:01:19.557 ******* >2018-08-30 12:03:33,410 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,426 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:03:33,426 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.049) 0:01:19.606 ******* >2018-08-30 12:03:33,453 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,469 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:03:33,469 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.043) 0:01:19.649 ******* >2018-08-30 12:03:33,502 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,518 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:03:33,518 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.048) 0:01:19.698 ******* >2018-08-30 12:03:33,554 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,574 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:03:33,574 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.056) 0:01:19.754 ******* >2018-08-30 12:03:33,605 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,622 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:03:33,623 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.048) 0:01:19.803 ******* >2018-08-30 12:03:33,654 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,671 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:03:33,671 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.048) 0:01:19.852 ******* >2018-08-30 12:03:33,702 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,716 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:03:33,716 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.044) 0:01:19.896 ******* >2018-08-30 12:03:33,746 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,760 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:03:33,760 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.044) 0:01:19.941 ******* >2018-08-30 12:03:33,789 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,803 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:03:33,803 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.043) 0:01:19.984 ******* >2018-08-30 12:03:33,831 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,846 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:03:33,846 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.042) 0:01:20.026 ******* >2018-08-30 12:03:33,872 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,886 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:03:33,886 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.039) 0:01:20.066 ******* >2018-08-30 12:03:33,915 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,930 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:03:33,930 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.043) 0:01:20.110 ******* >2018-08-30 12:03:33,959 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:33,975 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:03:33,975 p=7972 u=mistral | Thursday 30 August 2018 12:03:33 -0400 (0:00:00.045) 0:01:20.155 ******* >2018-08-30 12:03:34,005 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,018 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:03:34,019 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.043) 0:01:20.199 ******* >2018-08-30 12:03:34,046 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,061 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:03:34,061 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.042) 0:01:20.241 ******* >2018-08-30 12:03:34,299 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,311 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:03:34,312 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.250) 0:01:20.492 ******* >2018-08-30 12:03:34,338 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,357 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:03:34,358 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.046) 0:01:20.538 ******* >2018-08-30 12:03:34,389 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,404 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:03:34,405 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.046) 0:01:20.585 ******* >2018-08-30 12:03:34,435 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,451 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:03:34,451 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.046) 0:01:20.632 ******* >2018-08-30 12:03:34,483 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,499 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:03:34,499 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.047) 0:01:20.680 ******* >2018-08-30 12:03:34,532 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,547 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:03:34,548 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.048) 0:01:20.728 ******* >2018-08-30 12:03:34,577 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:34,591 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:03:34,592 p=7972 u=mistral | Thursday 30 August 2018 12:03:34 -0400 (0:00:00.044) 0:01:20.772 ******* >2018-08-30 12:03:35,027 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:35,042 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:03:35,042 p=7972 u=mistral | Thursday 30 August 2018 12:03:35 -0400 (0:00:00.450) 0:01:21.222 ******* >2018-08-30 12:03:35,098 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:35,114 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:03:35,115 p=7972 u=mistral | Thursday 30 August 2018 12:03:35 -0400 (0:00:00.072) 0:01:21.295 ******* >2018-08-30 12:03:35,176 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:35,191 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:03:35,192 p=7972 u=mistral | Thursday 30 August 2018 12:03:35 -0400 (0:00:00.076) 0:01:21.372 ******* >2018-08-30 12:03:35,214 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:35,245 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:03:35,245 p=7972 u=mistral | Thursday 30 August 2018 12:03:35 -0400 (0:00:00.053) 0:01:21.425 ******* >2018-08-30 12:03:35,336 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:03:35,364 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:03:35,365 p=7972 u=mistral | Thursday 30 August 2018 12:03:35 -0400 (0:00:00.119) 0:01:21.545 ******* >2018-08-30 12:03:35,715 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:03:35,735 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:03:35,735 p=7972 u=mistral | Thursday 30 August 2018 12:03:35 -0400 (0:00:00.370) 0:01:21.915 ******* >2018-08-30 12:03:35,972 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:03:35,988 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:03:35,988 p=7972 u=mistral | Thursday 30 August 2018 12:03:35 -0400 (0:00:00.253) 0:01:22.169 ******* >2018-08-30 12:03:36,017 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:36,037 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:03:36,037 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.048) 0:01:22.218 ******* >2018-08-30 12:03:36,290 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:03:36,311 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:03:36,311 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.273) 0:01:22.491 ******* >2018-08-30 12:03:36,339 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:36,357 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:03:36,358 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.046) 0:01:22.538 ******* >2018-08-30 12:03:36,419 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:36,437 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:03:36,438 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.079) 0:01:22.618 ******* >2018-08-30 12:03:36,467 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:36,489 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:03:36,489 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.051) 0:01:22.669 ******* >2018-08-30 12:03:36,517 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:36,535 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:03:36,536 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.046) 0:01:22.716 ******* >2018-08-30 12:03:36,563 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:36,583 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:03:36,583 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.047) 0:01:22.763 ******* >2018-08-30 12:03:36,609 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:36,628 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:03:36,628 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.045) 0:01:22.809 ******* >2018-08-30 12:03:36,691 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:36,705 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:03:36,706 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.077) 0:01:22.886 ******* >2018-08-30 12:03:36,731 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:36,745 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:03:36,746 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.039) 0:01:22.926 ******* >2018-08-30 12:03:36,808 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:36,822 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:03:36,822 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.076) 0:01:23.002 ******* >2018-08-30 12:03:36,892 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:36,906 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:03:36,906 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.084) 0:01:23.087 ******* >2018-08-30 12:03:36,976 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:36,991 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:03:36,991 p=7972 u=mistral | Thursday 30 August 2018 12:03:36 -0400 (0:00:00.085) 0:01:23.172 ******* >2018-08-30 12:03:37,034 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/dev/vdb) >2018-08-30 12:03:37,060 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:03:37,061 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.069) 0:01:23.241 ******* >2018-08-30 12:03:37,101 p=7972 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:03:37,115 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:03:37,116 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.054) 0:01:23.296 ******* >2018-08-30 12:03:37,143 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:37,159 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:03:37,159 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.043) 0:01:23.339 ******* >2018-08-30 12:03:37,186 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:37,202 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:03:37,202 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.043) 0:01:23.382 ******* >2018-08-30 12:03:37,232 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:37,247 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:03:37,248 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.045) 0:01:23.428 ******* >2018-08-30 12:03:37,280 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:37,293 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:03:37,294 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.046) 0:01:23.474 ******* >2018-08-30 12:03:37,325 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:37,340 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:03:37,341 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.046) 0:01:23.521 ******* >2018-08-30 12:03:37,415 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:37,430 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:03:37,431 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.090) 0:01:23.611 ******* >2018-08-30 12:03:37,487 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:37,503 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:03:37,503 p=7972 u=mistral | Thursday 30 August 2018 12:03:37 -0400 (0:00:00.072) 0:01:23.683 ******* >2018-08-30 12:03:37,845 p=7972 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:03:38,131 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/) >2018-08-30 12:03:38,419 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/mon) >2018-08-30 12:03:38,718 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/osd) >2018-08-30 12:03:39,002 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/mds) >2018-08-30 12:03:39,291 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/tmp) >2018-08-30 12:03:39,583 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:03:39,943 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:03:40,251 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:03:40,732 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:03:41,056 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:03:41,329 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:03:41,354 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:03:41,354 p=7972 u=mistral | Thursday 30 August 2018 12:03:41 -0400 (0:00:03.851) 0:01:27.534 ******* >2018-08-30 12:03:41,381 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:41,397 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:03:41,398 p=7972 u=mistral | Thursday 30 August 2018 12:03:41 -0400 (0:00:00.043) 0:01:27.578 ******* >2018-08-30 12:03:41,439 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:41,454 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:03:41,454 p=7972 u=mistral | Thursday 30 August 2018 12:03:41 -0400 (0:00:00.056) 0:01:27.634 ******* >2018-08-30 12:03:41,483 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:41,506 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:03:41,507 p=7972 u=mistral | Thursday 30 August 2018 12:03:41 -0400 (0:00:00.052) 0:01:27.687 ******* >2018-08-30 12:03:41,849 p=7972 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:03:42,200 p=7972 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:03:42,217 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:03:42,217 p=7972 u=mistral | Thursday 30 August 2018 12:03:42 -0400 (0:00:00.710) 0:01:28.397 ******* >2018-08-30 12:03:42,284 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:42,297 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:03:42,298 p=7972 u=mistral | Thursday 30 August 2018 12:03:42 -0400 (0:00:00.080) 0:01:28.478 ******* >2018-08-30 12:03:42,324 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:42,338 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:03:42,338 p=7972 u=mistral | Thursday 30 August 2018 12:03:42 -0400 (0:00:00.040) 0:01:28.519 ******* >2018-08-30 12:03:42,695 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:42,709 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:03:42,710 p=7972 u=mistral | Thursday 30 August 2018 12:03:42 -0400 (0:00:00.371) 0:01:28.890 ******* >2018-08-30 12:03:42,763 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:42,778 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:03:42,778 p=7972 u=mistral | Thursday 30 August 2018 12:03:42 -0400 (0:00:00.068) 0:01:28.958 ******* >2018-08-30 12:03:43,115 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:43,130 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:03:43,131 p=7972 u=mistral | Thursday 30 August 2018 12:03:43 -0400 (0:00:00.352) 0:01:29.311 ******* >2018-08-30 12:03:43,231 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:43,247 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:03:43,247 p=7972 u=mistral | Thursday 30 August 2018 12:03:43 -0400 (0:00:00.116) 0:01:29.427 ******* >2018-08-30 12:03:43,432 p=7972 u=mistral | ok: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:03:43,565 p=7972 u=mistral | ok: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:03:43,692 p=7972 u=mistral | ok: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:03:43,709 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:03:43,709 p=7972 u=mistral | Thursday 30 August 2018 12:03:43 -0400 (0:00:00.462) 0:01:29.889 ******* >2018-08-30 12:03:43,815 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:43,830 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:03:43,830 p=7972 u=mistral | Thursday 30 August 2018 12:03:43 -0400 (0:00:00.120) 0:01:30.010 ******* >2018-08-30 12:03:43,946 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:03:43,969 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:03:43,970 p=7972 u=mistral | Thursday 30 August 2018 12:03:43 -0400 (0:00:00.139) 0:01:30.150 ******* >2018-08-30 12:03:44,295 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:03:44,580 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/monmap-ceph) >2018-08-30 12:03:44,880 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:03:45,153 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:03:45,423 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:03:45,732 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:03:46,025 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:03:46,299 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller03.keyring) >2018-08-30 12:03:46,570 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller01.keyring) >2018-08-30 12:03:46,843 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller02.keyring) >2018-08-30 12:03:46,862 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:03:46,862 p=7972 u=mistral | Thursday 30 August 2018 12:03:46 -0400 (0:00:02.892) 0:01:33.042 ******* >2018-08-30 12:03:46,968 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,027 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/monmap-ceph', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/monmap-ceph', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/monmap-ceph', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,083 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,145 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,203 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,265 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,322 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,382 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mgr.lab-controller03.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,440 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mgr.lab-controller01.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,497 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mgr.lab-controller02.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:03:47,518 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:03:47,518 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.655) 0:01:33.698 ******* >2018-08-30 12:03:47,540 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,554 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:03:47,554 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.035) 0:01:33.734 ******* >2018-08-30 12:03:47,574 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,588 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:03:47,589 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.034) 0:01:33.769 ******* >2018-08-30 12:03:47,618 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,632 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:03:47,632 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.043) 0:01:33.812 ******* >2018-08-30 12:03:47,667 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,683 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:03:47,683 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.051) 0:01:33.863 ******* >2018-08-30 12:03:47,710 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,724 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:03:47,725 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.041) 0:01:33.905 ******* >2018-08-30 12:03:47,750 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,767 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:03:47,767 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.042) 0:01:33.947 ******* >2018-08-30 12:03:47,796 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,815 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:03:47,815 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.047) 0:01:33.995 ******* >2018-08-30 12:03:47,844 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,864 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:03:47,864 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.048) 0:01:34.044 ******* >2018-08-30 12:03:47,899 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,913 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:03:47,914 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.049) 0:01:34.094 ******* >2018-08-30 12:03:47,939 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,954 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:03:47,954 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.040) 0:01:34.134 ******* >2018-08-30 12:03:47,982 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:47,997 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:03:47,997 p=7972 u=mistral | Thursday 30 August 2018 12:03:47 -0400 (0:00:00.043) 0:01:34.178 ******* >2018-08-30 12:03:48,032 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,046 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:03:48,046 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.048) 0:01:34.227 ******* >2018-08-30 12:03:48,083 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,097 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:03:48,097 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.050) 0:01:34.278 ******* >2018-08-30 12:03:48,129 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,143 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:03:48,143 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.045) 0:01:34.323 ******* >2018-08-30 12:03:48,170 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,185 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:03:48,185 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.042) 0:01:34.365 ******* >2018-08-30 12:03:48,222 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,236 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:03:48,236 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.051) 0:01:34.417 ******* >2018-08-30 12:03:48,272 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,288 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:03:48,288 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.051) 0:01:34.469 ******* >2018-08-30 12:03:48,321 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,335 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:03:48,335 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.046) 0:01:34.515 ******* >2018-08-30 12:03:48,362 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,376 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:03:48,376 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.041) 0:01:34.557 ******* >2018-08-30 12:03:48,409 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,422 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:03:48,422 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.045) 0:01:34.602 ******* >2018-08-30 12:03:48,450 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,464 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:03:48,464 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.041) 0:01:34.644 ******* >2018-08-30 12:03:48,490 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,504 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:03:48,504 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.040) 0:01:34.684 ******* >2018-08-30 12:03:48,533 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,547 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:03:48,547 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.042) 0:01:34.727 ******* >2018-08-30 12:03:48,582 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,598 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:03:48,599 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.051) 0:01:34.779 ******* >2018-08-30 12:03:48,626 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,642 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:03:48,642 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.043) 0:01:34.822 ******* >2018-08-30 12:03:48,668 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,682 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:03:48,683 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.040) 0:01:34.863 ******* >2018-08-30 12:03:48,711 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,725 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:03:48,726 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.042) 0:01:34.906 ******* >2018-08-30 12:03:48,751 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,768 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:03:48,768 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.042) 0:01:34.948 ******* >2018-08-30 12:03:48,796 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:03:48,813 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:03:48,813 p=7972 u=mistral | Thursday 30 August 2018 12:03:48 -0400 (0:00:00.044) 0:01:34.994 ******* >2018-08-30 12:04:11,343 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:11,361 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:04:11,361 p=7972 u=mistral | Thursday 30 August 2018 12:04:11 -0400 (0:00:22.547) 0:01:57.541 ******* >2018-08-30 12:04:11,727 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:04:11,749 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:04:11,749 p=7972 u=mistral | Thursday 30 August 2018 12:04:11 -0400 (0:00:00.388) 0:01:57.930 ******* >2018-08-30 12:04:11,811 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:11,827 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:04:11,828 p=7972 u=mistral | Thursday 30 August 2018 12:04:11 -0400 (0:00:00.078) 0:01:58.008 ******* >2018-08-30 12:04:11,859 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:11,874 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:04:11,875 p=7972 u=mistral | Thursday 30 August 2018 12:04:11 -0400 (0:00:00.046) 0:01:58.055 ******* >2018-08-30 12:04:11,901 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:11,915 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:04:11,915 p=7972 u=mistral | Thursday 30 August 2018 12:04:11 -0400 (0:00:00.040) 0:01:58.096 ******* >2018-08-30 12:04:11,942 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:11,956 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:04:11,956 p=7972 u=mistral | Thursday 30 August 2018 12:04:11 -0400 (0:00:00.040) 0:01:58.136 ******* >2018-08-30 12:04:11,985 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:11,998 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:04:11,998 p=7972 u=mistral | Thursday 30 August 2018 12:04:11 -0400 (0:00:00.042) 0:01:58.178 ******* >2018-08-30 12:04:12,035 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:12,052 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:04:12,052 p=7972 u=mistral | Thursday 30 August 2018 12:04:12 -0400 (0:00:00.053) 0:01:58.232 ******* >2018-08-30 12:04:12,080 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:12,097 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:04:12,097 p=7972 u=mistral | Thursday 30 August 2018 12:04:12 -0400 (0:00:00.044) 0:01:58.277 ******* >2018-08-30 12:04:12,122 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:12,141 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:04:12,142 p=7972 u=mistral | Thursday 30 August 2018 12:04:12 -0400 (0:00:00.044) 0:01:58.322 ******* >2018-08-30 12:04:12,172 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:12,187 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:04:12,188 p=7972 u=mistral | Thursday 30 August 2018 12:04:12 -0400 (0:00:00.046) 0:01:58.368 ******* >2018-08-30 12:04:12,219 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:12,240 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:04:12,240 p=7972 u=mistral | Thursday 30 August 2018 12:04:12 -0400 (0:00:00.052) 0:01:58.420 ******* >2018-08-30 12:04:12,268 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:12,285 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:04:12,285 p=7972 u=mistral | Thursday 30 August 2018 12:04:12 -0400 (0:00:00.045) 0:01:58.466 ******* >2018-08-30 12:04:12,320 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:12,334 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:04:12,334 p=7972 u=mistral | Thursday 30 August 2018 12:04:12 -0400 (0:00:00.048) 0:01:58.515 ******* >2018-08-30 12:04:13,394 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:13,411 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:04:13,412 p=7972 u=mistral | Thursday 30 August 2018 12:04:13 -0400 (0:00:01.077) 0:01:59.592 ******* >2018-08-30 12:04:13,467 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:13,486 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:04:13,486 p=7972 u=mistral | Thursday 30 August 2018 12:04:13 -0400 (0:00:00.074) 0:01:59.666 ******* >2018-08-30 12:04:13,514 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:13,530 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:04:13,530 p=7972 u=mistral | Thursday 30 August 2018 12:04:13 -0400 (0:00:00.043) 0:01:59.710 ******* >2018-08-30 12:04:13,560 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:13,576 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:04:13,576 p=7972 u=mistral | Thursday 30 August 2018 12:04:13 -0400 (0:00:00.046) 0:01:59.757 ******* >2018-08-30 12:04:13,635 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:13,651 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:04:13,652 p=7972 u=mistral | Thursday 30 August 2018 12:04:13 -0400 (0:00:00.075) 0:01:59.832 ******* >2018-08-30 12:04:13,682 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:13,696 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:04:13,697 p=7972 u=mistral | Thursday 30 August 2018 12:04:13 -0400 (0:00:00.044) 0:01:59.877 ******* >2018-08-30 12:04:13,723 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:13,738 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:04:13,739 p=7972 u=mistral | Thursday 30 August 2018 12:04:13 -0400 (0:00:00.042) 0:01:59.919 ******* >2018-08-30 12:04:14,058 p=7972 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:04:14,346 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:04:14,637 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:04:14,943 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:04:15,224 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:04:15,243 p=7972 u=mistral | TASK [ceph-mon : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:04:15,244 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:01.504) 0:02:01.424 ******* >2018-08-30 12:04:15,316 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:15,334 p=7972 u=mistral | TASK [ceph-mon : make sure monitor_interface or monitor_address or monitor_address_block is configured] *** >2018-08-30 12:04:15,334 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.090) 0:02:01.514 ******* >2018-08-30 12:04:15,372 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,402 p=7972 u=mistral | TASK [ceph-mon : generate monitor initial keyring] ***************************** >2018-08-30 12:04:15,403 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.068) 0:02:01.583 ******* >2018-08-30 12:04:15,443 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,468 p=7972 u=mistral | TASK [ceph-mon : read monitor initial keyring if it already exists] ************ >2018-08-30 12:04:15,468 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.064) 0:02:01.648 ******* >2018-08-30 12:04:15,499 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,515 p=7972 u=mistral | TASK [ceph-mon : create monitor initial keyring] ******************************* >2018-08-30 12:04:15,516 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.047) 0:02:01.696 ******* >2018-08-30 12:04:15,542 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,558 p=7972 u=mistral | TASK [ceph-mon : set initial monitor key permissions] ************************** >2018-08-30 12:04:15,558 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.042) 0:02:01.738 ******* >2018-08-30 12:04:15,590 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,605 p=7972 u=mistral | TASK [ceph-mon : create (and fix ownership of) monitor directory] ************** >2018-08-30 12:04:15,606 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.047) 0:02:01.786 ******* >2018-08-30 12:04:15,633 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,650 p=7972 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap >= ceph_release_num.luminous] *** >2018-08-30 12:04:15,650 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.044) 0:02:01.830 ******* >2018-08-30 12:04:15,679 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,694 p=7972 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap < ceph_release_num.luminous] *** >2018-08-30 12:04:15,694 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.043) 0:02:01.874 ******* >2018-08-30 12:04:15,729 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,746 p=7972 u=mistral | TASK [ceph-mon : create custom admin keyring] ********************************** >2018-08-30 12:04:15,746 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.052) 0:02:01.927 ******* >2018-08-30 12:04:15,774 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,791 p=7972 u=mistral | TASK [ceph-mon : set ownership of admin keyring] ******************************* >2018-08-30 12:04:15,791 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.044) 0:02:01.972 ******* >2018-08-30 12:04:15,824 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,839 p=7972 u=mistral | TASK [ceph-mon : import admin keyring into mon keyring] ************************ >2018-08-30 12:04:15,839 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.047) 0:02:02.019 ******* >2018-08-30 12:04:15,869 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,886 p=7972 u=mistral | TASK [ceph-mon : ceph monitor mkfs with keyring] ******************************* >2018-08-30 12:04:15,886 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.047) 0:02:02.066 ******* >2018-08-30 12:04:15,914 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,930 p=7972 u=mistral | TASK [ceph-mon : ceph monitor mkfs without keyring] **************************** >2018-08-30 12:04:15,930 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.044) 0:02:02.110 ******* >2018-08-30 12:04:15,956 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:15,972 p=7972 u=mistral | TASK [ceph-mon : ensure systemd service override directory exists] ************* >2018-08-30 12:04:15,972 p=7972 u=mistral | Thursday 30 August 2018 12:04:15 -0400 (0:00:00.042) 0:02:02.153 ******* >2018-08-30 12:04:16,003 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:16,023 p=7972 u=mistral | TASK [ceph-mon : add ceph-mon systemd service overrides] *********************** >2018-08-30 12:04:16,024 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.051) 0:02:02.204 ******* >2018-08-30 12:04:16,058 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:16,075 p=7972 u=mistral | TASK [ceph-mon : start the monitor service] ************************************ >2018-08-30 12:04:16,076 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.051) 0:02:02.256 ******* >2018-08-30 12:04:16,108 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:16,122 p=7972 u=mistral | TASK [ceph-mon : enable the ceph-mon.target service] *************************** >2018-08-30 12:04:16,123 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.046) 0:02:02.303 ******* >2018-08-30 12:04:16,151 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:16,166 p=7972 u=mistral | TASK [ceph-mon : include ceph_keys.yml] **************************************** >2018-08-30 12:04:16,166 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.043) 0:02:02.346 ******* >2018-08-30 12:04:16,195 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:16,209 p=7972 u=mistral | TASK [ceph-mon : collect all the pools] **************************************** >2018-08-30 12:04:16,210 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.043) 0:02:02.390 ******* >2018-08-30 12:04:16,235 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:16,252 p=7972 u=mistral | TASK [ceph-mon : secure the cluster] ******************************************* >2018-08-30 12:04:16,252 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.042) 0:02:02.432 ******* >2018-08-30 12:04:16,301 p=7972 u=mistral | TASK [ceph-mon : set_fact ceph_config_keys] ************************************ >2018-08-30 12:04:16,302 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.049) 0:02:02.482 ******* >2018-08-30 12:04:16,374 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:16,390 p=7972 u=mistral | TASK [ceph-mon : register rbd bootstrap key] *********************************** >2018-08-30 12:04:16,390 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.088) 0:02:02.570 ******* >2018-08-30 12:04:16,474 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:16,492 p=7972 u=mistral | TASK [ceph-mon : merge rbd bootstrap key to config and keys paths] ************* >2018-08-30 12:04:16,493 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.102) 0:02:02.673 ******* >2018-08-30 12:04:16,569 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:16,591 p=7972 u=mistral | TASK [ceph-mon : stat for ceph config and keys] ******************************** >2018-08-30 12:04:16,591 p=7972 u=mistral | Thursday 30 August 2018 12:04:16 -0400 (0:00:00.098) 0:02:02.771 ******* >2018-08-30 12:04:16,856 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:04:17,108 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:04:17,336 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:04:17,555 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:04:17,775 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:04:17,989 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:04:18,006 p=7972 u=mistral | TASK [ceph-mon : try to copy ceph keys] **************************************** >2018-08-30 12:04:18,007 p=7972 u=mistral | Thursday 30 August 2018 12:04:18 -0400 (0:00:01.415) 0:02:04.187 ******* >2018-08-30 12:04:18,073 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:18,097 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:18,125 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:18,149 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:18,178 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:18,206 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:18,225 p=7972 u=mistral | TASK [ceph-mon : populate kv_store with default ceph.conf] ********************* >2018-08-30 12:04:18,225 p=7972 u=mistral | Thursday 30 August 2018 12:04:18 -0400 (0:00:00.218) 0:02:04.405 ******* >2018-08-30 12:04:18,250 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:04:18,262 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:18,279 p=7972 u=mistral | TASK [ceph-mon : populate kv_store with custom ceph.conf] ********************** >2018-08-30 12:04:18,279 p=7972 u=mistral | Thursday 30 August 2018 12:04:18 -0400 (0:00:00.054) 0:02:04.460 ******* >2018-08-30 12:04:18,302 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:04:18,312 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:18,338 p=7972 u=mistral | TASK [ceph-mon : delete populate-kv-store docker] ****************************** >2018-08-30 12:04:18,338 p=7972 u=mistral | Thursday 30 August 2018 12:04:18 -0400 (0:00:00.058) 0:02:04.518 ******* >2018-08-30 12:04:18,362 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:18,378 p=7972 u=mistral | TASK [ceph-mon : generate systemd unit file] *********************************** >2018-08-30 12:04:18,379 p=7972 u=mistral | Thursday 30 August 2018 12:04:18 -0400 (0:00:00.040) 0:02:04.559 ******* >2018-08-30 12:04:20,000 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:04:20,012 p=7972 u=mistral | TASK [ceph-mon : systemd start mon container] ********************************** >2018-08-30 12:04:20,012 p=7972 u=mistral | Thursday 30 August 2018 12:04:20 -0400 (0:00:01.633) 0:02:06.192 ******* >2018-08-30 12:04:20,923 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:04:20,941 p=7972 u=mistral | TASK [ceph-mon : configure ceph profile.d aliases] ***************************** >2018-08-30 12:04:20,941 p=7972 u=mistral | Thursday 30 August 2018 12:04:20 -0400 (0:00:00.929) 0:02:07.121 ******* >2018-08-30 12:04:22,081 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:04:22,097 p=7972 u=mistral | TASK [ceph-mon : wait for monitor socket to exist] ***************************** >2018-08-30 12:04:22,097 p=7972 u=mistral | Thursday 30 August 2018 12:04:22 -0400 (0:00:01.156) 0:02:08.277 ******* >2018-08-30 12:04:22,554 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:04:22,571 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:04:22,571 p=7972 u=mistral | Thursday 30 August 2018 12:04:22 -0400 (0:00:00.473) 0:02:08.751 ******* >2018-08-30 12:04:22,632 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:22,649 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:04:22,650 p=7972 u=mistral | Thursday 30 August 2018 12:04:22 -0400 (0:00:00.078) 0:02:08.830 ******* >2018-08-30 12:04:22,710 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:22,725 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:04:22,726 p=7972 u=mistral | Thursday 30 August 2018 12:04:22 -0400 (0:00:00.075) 0:02:08.906 ******* >2018-08-30 12:04:23,395 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:23,413 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:04:23,413 p=7972 u=mistral | Thursday 30 August 2018 12:04:23 -0400 (0:00:00.687) 0:02:09.594 ******* >2018-08-30 12:04:23,451 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:23,466 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:04:23,467 p=7972 u=mistral | Thursday 30 August 2018 12:04:23 -0400 (0:00:00.053) 0:02:09.647 ******* >2018-08-30 12:04:23,499 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:23,516 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:04:23,516 p=7972 u=mistral | Thursday 30 August 2018 12:04:23 -0400 (0:00:00.049) 0:02:09.697 ******* >2018-08-30 12:04:23,553 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:23,569 p=7972 u=mistral | TASK [ceph-mon : push ceph files to the ansible server] ************************ >2018-08-30 12:04:23,569 p=7972 u=mistral | Thursday 30 August 2018 12:04:23 -0400 (0:00:00.052) 0:02:09.749 ******* >2018-08-30 12:04:24,214 p=7972 u=mistral | changed: [172.16.0.33] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:24,506 p=7972 u=mistral | ok: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:24,833 p=7972 u=mistral | changed: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:25,155 p=7972 u=mistral | changed: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:25,451 p=7972 u=mistral | changed: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:25,760 p=7972 u=mistral | ok: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:25,779 p=7972 u=mistral | TASK [ceph-mon : create ceph rest api keyring when mon is containerized] ******* >2018-08-30 12:04:25,779 p=7972 u=mistral | Thursday 30 August 2018 12:04:25 -0400 (0:00:02.209) 0:02:11.959 ******* >2018-08-30 12:04:25,809 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:25,825 p=7972 u=mistral | TASK [ceph-mon : create ceph mgr keyring(s) when mon is containerized] ********* >2018-08-30 12:04:25,825 p=7972 u=mistral | Thursday 30 August 2018 12:04:25 -0400 (0:00:00.046) 0:02:12.005 ******* >2018-08-30 12:04:25,869 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:04:25,881 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:04:25,892 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:04:25,908 p=7972 u=mistral | TASK [ceph-mon : stat for ceph mgr key(s)] ************************************* >2018-08-30 12:04:25,909 p=7972 u=mistral | Thursday 30 August 2018 12:04:25 -0400 (0:00:00.083) 0:02:12.089 ******* >2018-08-30 12:04:25,950 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:04:25,961 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:04:25,972 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:04:25,990 p=7972 u=mistral | TASK [ceph-mon : fetch ceph mgr key(s)] **************************************** >2018-08-30 12:04:25,990 p=7972 u=mistral | Thursday 30 August 2018 12:04:25 -0400 (0:00:00.081) 0:02:12.170 ******* >2018-08-30 12:04:26,030 p=7972 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.33', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:04:26,043 p=7972 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.24', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:04:26,054 p=7972 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.25', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:04:26,082 p=7972 u=mistral | TASK [ceph-mon : configure crush hierarchy] ************************************ >2018-08-30 12:04:26,082 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.091) 0:02:12.262 ******* >2018-08-30 12:04:26,113 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.28) >2018-08-30 12:04:26,118 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.36) >2018-08-30 12:04:26,124 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.32) >2018-08-30 12:04:26,138 p=7972 u=mistral | TASK [ceph-mon : create configured crush rules] ******************************** >2018-08-30 12:04:26,139 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.056) 0:02:12.319 ******* >2018-08-30 12:04:26,172 p=7972 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:04:26,178 p=7972 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:04:26,192 p=7972 u=mistral | TASK [ceph-mon : get id for new default crush rule] **************************** >2018-08-30 12:04:26,192 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.053) 0:02:12.373 ******* >2018-08-30 12:04:26,226 p=7972 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:04:26,231 p=7972 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:04:26,246 p=7972 u=mistral | TASK [ceph-mon : set_fact info_ceph_default_crush_rule_yaml] ******************* >2018-08-30 12:04:26,246 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.053) 0:02:12.426 ******* >2018-08-30 12:04:26,277 p=7972 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'HDD', u'name': u'HDD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:04:26,281 p=7972 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'SSD', u'name': u'SSD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:04:26,296 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_crush_rule to osd_pool_default_crush_replicated_ruleset if release < luminous else osd_pool_default_crush_rule] *** >2018-08-30 12:04:26,296 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.050) 0:02:12.476 ******* >2018-08-30 12:04:26,317 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:26,366 p=7972 u=mistral | TASK [ceph-mon : insert new default crush rule into daemon to prevent restart] *** >2018-08-30 12:04:26,366 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.070) 0:02:12.546 ******* >2018-08-30 12:04:26,397 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:04:26,402 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:04:26,407 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:04:26,460 p=7972 u=mistral | TASK [ceph-mon : add new default crush rule to ceph.conf] ********************** >2018-08-30 12:04:26,460 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.093) 0:02:12.640 ******* >2018-08-30 12:04:26,493 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:04:26,497 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:04:26,503 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:04:26,524 p=7972 u=mistral | TASK [ceph-mon : get default value for osd_pool_default_pg_num] **************** >2018-08-30 12:04:26,525 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.064) 0:02:12.705 ******* >2018-08-30 12:04:26,561 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:26,577 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with pool_default_pg_num (backward compatibility)] *** >2018-08-30 12:04:26,577 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.052) 0:02:12.757 ******* >2018-08-30 12:04:26,610 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:26,628 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with default_pool_default_pg_num.stdout] *** >2018-08-30 12:04:26,628 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.051) 0:02:12.808 ******* >2018-08-30 12:04:26,658 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:26,679 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num ceph_conf_overrides.global.osd_pool_default_pg_num] *** >2018-08-30 12:04:26,680 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.051) 0:02:12.860 ******* >2018-08-30 12:04:26,764 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:26,779 p=7972 u=mistral | TASK [ceph-mon : increase calamari logging level when debug is on] ************* >2018-08-30 12:04:26,779 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.099) 0:02:12.959 ******* >2018-08-30 12:04:26,821 p=7972 u=mistral | skipping: [172.16.0.33] => (item=cthulhu) >2018-08-30 12:04:26,826 p=7972 u=mistral | skipping: [172.16.0.33] => (item=calamari_web) >2018-08-30 12:04:26,840 p=7972 u=mistral | TASK [ceph-mon : initialize the calamari server api] *************************** >2018-08-30 12:04:26,840 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.061) 0:02:13.020 ******* >2018-08-30 12:04:26,861 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:04:26,862 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:04:26,862 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.021) 0:02:13.042 ******* >2018-08-30 12:04:26,933 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:26,934 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:04:26,934 p=7972 u=mistral | Thursday 30 August 2018 12:04:26 -0400 (0:00:00.071) 0:02:13.114 ******* >2018-08-30 12:04:27,753 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:04:27,754 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:04:27,755 p=7972 u=mistral | Thursday 30 August 2018 12:04:27 -0400 (0:00:00.820) 0:02:13.935 ******* >2018-08-30 12:04:27,848 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:04:27,855 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:04:27,864 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:04:27,866 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:04:27,866 p=7972 u=mistral | Thursday 30 August 2018 12:04:27 -0400 (0:00:00.111) 0:02:14.046 ******* >2018-08-30 12:04:27,987 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:04:28,021 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:04:28,056 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:04:28,058 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:04:28,058 p=7972 u=mistral | Thursday 30 August 2018 12:04:28 -0400 (0:00:00.191) 0:02:14.238 ******* >2018-08-30 12:04:28,123 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:04:28,149 p=7972 u=mistral | TASK [non container | waiting for the monitor to join the quorum...] *********** >2018-08-30 12:04:28,149 p=7972 u=mistral | Thursday 30 August 2018 12:04:28 -0400 (0:00:00.090) 0:02:14.329 ******* >2018-08-30 12:04:28,864 p=7972 u=mistral | changed: [172.16.0.33 -> 172.16.0.25] >2018-08-30 12:04:28,878 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph mon] ************** >2018-08-30 12:04:29,005 p=7972 u=mistral | TASK [select a running monitor] ************************************************ >2018-08-30 12:04:29,006 p=7972 u=mistral | Thursday 30 August 2018 12:04:29 -0400 (0:00:00.856) 0:02:15.186 ******* >2018-08-30 12:04:29,068 p=7972 u=mistral | ok: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:04:29,074 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:04:29,257 p=7972 u=mistral | ok: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:04:29,271 p=7972 u=mistral | TASK [stop non-containerized ceph mon] ***************************************** >2018-08-30 12:04:29,271 p=7972 u=mistral | Thursday 30 August 2018 12:04:29 -0400 (0:00:00.265) 0:02:15.451 ******* >2018-08-30 12:04:29,949 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:04:29,964 p=7972 u=mistral | TASK [set_fact ceph_uid for ubuntu] ******************************************** >2018-08-30 12:04:29,964 p=7972 u=mistral | Thursday 30 August 2018 12:04:29 -0400 (0:00:00.692) 0:02:16.144 ******* >2018-08-30 12:04:29,990 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:30,003 p=7972 u=mistral | TASK [set_fact ceph_uid for red hat] ******************************************* >2018-08-30 12:04:30,004 p=7972 u=mistral | Thursday 30 August 2018 12:04:30 -0400 (0:00:00.039) 0:02:16.184 ******* >2018-08-30 12:04:30,029 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:30,043 p=7972 u=mistral | TASK [set_fact ceph_uid for rhel] ********************************************** >2018-08-30 12:04:30,043 p=7972 u=mistral | Thursday 30 August 2018 12:04:30 -0400 (0:00:00.039) 0:02:16.223 ******* >2018-08-30 12:04:30,099 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:30,113 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:04:30,113 p=7972 u=mistral | Thursday 30 August 2018 12:04:30 -0400 (0:00:00.069) 0:02:16.293 ******* >2018-08-30 12:04:30,486 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph) >2018-08-30 12:04:30,763 p=7972 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:04:30,779 p=7972 u=mistral | TASK [check for existing old leveldb file extension (ldb)] ********************* >2018-08-30 12:04:30,780 p=7972 u=mistral | Thursday 30 August 2018 12:04:30 -0400 (0:00:00.666) 0:02:16.960 ******* >2018-08-30 12:04:31,088 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:31,103 p=7972 u=mistral | TASK [rename leveldb extension from ldb to sst] ******************************** >2018-08-30 12:04:31,103 p=7972 u=mistral | Thursday 30 August 2018 12:04:31 -0400 (0:00:00.323) 0:02:17.284 ******* >2018-08-30 12:04:31,127 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:31,143 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:04:31,144 p=7972 u=mistral | Thursday 30 August 2018 12:04:31 -0400 (0:00:00.040) 0:02:17.324 ******* >2018-08-30 12:04:31,494 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:31,510 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:04:31,511 p=7972 u=mistral | Thursday 30 August 2018 12:04:31 -0400 (0:00:00.366) 0:02:17.691 ******* >2018-08-30 12:04:31,541 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:31,557 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:04:31,557 p=7972 u=mistral | Thursday 30 August 2018 12:04:31 -0400 (0:00:00.046) 0:02:17.737 ******* >2018-08-30 12:04:31,587 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:31,606 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:04:31,606 p=7972 u=mistral | Thursday 30 August 2018 12:04:31 -0400 (0:00:00.049) 0:02:17.787 ******* >2018-08-30 12:04:31,639 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:31,654 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:04:31,654 p=7972 u=mistral | Thursday 30 August 2018 12:04:31 -0400 (0:00:00.047) 0:02:17.834 ******* >2018-08-30 12:04:31,992 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:32,015 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:04:32,016 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.361) 0:02:18.196 ******* >2018-08-30 12:04:32,049 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,068 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:04:32,068 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.052) 0:02:18.248 ******* >2018-08-30 12:04:32,101 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,122 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:04:32,122 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.054) 0:02:18.302 ******* >2018-08-30 12:04:32,154 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,179 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:04:32,180 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.057) 0:02:18.360 ******* >2018-08-30 12:04:32,215 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,235 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:04:32,236 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.055) 0:02:18.416 ******* >2018-08-30 12:04:32,264 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,277 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:04:32,277 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.041) 0:02:18.457 ******* >2018-08-30 12:04:32,303 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,316 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:04:32,317 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.039) 0:02:18.497 ******* >2018-08-30 12:04:32,342 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,356 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:04:32,357 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.039) 0:02:18.537 ******* >2018-08-30 12:04:32,380 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,394 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:04:32,395 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.037) 0:02:18.575 ******* >2018-08-30 12:04:32,420 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,433 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:04:32,433 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.038) 0:02:18.614 ******* >2018-08-30 12:04:32,456 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,470 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:04:32,470 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.036) 0:02:18.650 ******* >2018-08-30 12:04:32,495 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,510 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:04:32,510 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.040) 0:02:18.690 ******* >2018-08-30 12:04:32,539 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,554 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:04:32,555 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.044) 0:02:18.735 ******* >2018-08-30 12:04:32,583 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,600 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:04:32,600 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.045) 0:02:18.780 ******* >2018-08-30 12:04:32,632 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,647 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:04:32,647 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.047) 0:02:18.828 ******* >2018-08-30 12:04:32,675 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,692 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:04:32,692 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.044) 0:02:18.872 ******* >2018-08-30 12:04:32,720 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,740 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:04:32,741 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.048) 0:02:18.921 ******* >2018-08-30 12:04:32,768 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,782 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:04:32,783 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.042) 0:02:18.963 ******* >2018-08-30 12:04:32,811 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,827 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:04:32,827 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.044) 0:02:19.007 ******* >2018-08-30 12:04:32,855 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,872 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:04:32,873 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.045) 0:02:19.053 ******* >2018-08-30 12:04:32,904 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,920 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:04:32,921 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.048) 0:02:19.101 ******* >2018-08-30 12:04:32,950 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:32,968 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:04:32,968 p=7972 u=mistral | Thursday 30 August 2018 12:04:32 -0400 (0:00:00.047) 0:02:19.148 ******* >2018-08-30 12:04:33,003 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:33,024 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:04:33,024 p=7972 u=mistral | Thursday 30 August 2018 12:04:33 -0400 (0:00:00.055) 0:02:19.204 ******* >2018-08-30 12:04:33,050 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:33,068 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:04:33,068 p=7972 u=mistral | Thursday 30 August 2018 12:04:33 -0400 (0:00:00.044) 0:02:19.248 ******* >2018-08-30 12:04:33,370 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:33,389 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:04:33,389 p=7972 u=mistral | Thursday 30 August 2018 12:04:33 -0400 (0:00:00.321) 0:02:19.569 ******* >2018-08-30 12:04:33,462 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:33,477 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:04:33,477 p=7972 u=mistral | Thursday 30 August 2018 12:04:33 -0400 (0:00:00.088) 0:02:19.658 ******* >2018-08-30 12:04:33,545 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:33,560 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:04:33,561 p=7972 u=mistral | Thursday 30 August 2018 12:04:33 -0400 (0:00:00.083) 0:02:19.741 ******* >2018-08-30 12:04:33,587 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:33,614 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:04:33,615 p=7972 u=mistral | Thursday 30 August 2018 12:04:33 -0400 (0:00:00.053) 0:02:19.795 ******* >2018-08-30 12:04:33,711 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:04:33,742 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:04:33,742 p=7972 u=mistral | Thursday 30 August 2018 12:04:33 -0400 (0:00:00.127) 0:02:19.922 ******* >2018-08-30 12:04:34,643 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:04:34,666 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:04:34,666 p=7972 u=mistral | Thursday 30 August 2018 12:04:34 -0400 (0:00:00.924) 0:02:20.846 ******* >2018-08-30 12:04:34,900 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:04:34,915 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:04:34,916 p=7972 u=mistral | Thursday 30 August 2018 12:04:34 -0400 (0:00:00.249) 0:02:21.096 ******* >2018-08-30 12:04:34,949 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:34,971 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:04:34,971 p=7972 u=mistral | Thursday 30 August 2018 12:04:34 -0400 (0:00:00.055) 0:02:21.151 ******* >2018-08-30 12:04:35,212 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:04:35,227 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:04:35,227 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.255) 0:02:21.407 ******* >2018-08-30 12:04:35,289 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:35,304 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:04:35,305 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.077) 0:02:21.485 ******* >2018-08-30 12:04:35,362 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:35,381 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:04:35,382 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.077) 0:02:21.562 ******* >2018-08-30 12:04:35,405 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:35,423 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:04:35,424 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.041) 0:02:21.604 ******* >2018-08-30 12:04:35,655 p=7972 u=mistral | changed: [172.16.0.24 -> localhost] >2018-08-30 12:04:35,673 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:04:35,673 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.249) 0:02:21.853 ******* >2018-08-30 12:04:35,700 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:35,718 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:04:35,718 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.044) 0:02:21.898 ******* >2018-08-30 12:04:35,745 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:35,764 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:04:35,765 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.046) 0:02:21.945 ******* >2018-08-30 12:04:35,827 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:35,842 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:04:35,842 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.077) 0:02:22.022 ******* >2018-08-30 12:04:35,865 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:35,879 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:04:35,880 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.037) 0:02:22.060 ******* >2018-08-30 12:04:35,951 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:35,965 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:04:35,965 p=7972 u=mistral | Thursday 30 August 2018 12:04:35 -0400 (0:00:00.085) 0:02:22.145 ******* >2018-08-30 12:04:36,023 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:36,037 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:04:36,038 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.072) 0:02:22.218 ******* >2018-08-30 12:04:36,119 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:36,134 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:04:36,134 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.096) 0:02:22.314 ******* >2018-08-30 12:04:36,172 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/dev/vdb) >2018-08-30 12:04:36,186 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:04:36,187 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.052) 0:02:22.367 ******* >2018-08-30 12:04:36,227 p=7972 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:04:36,243 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:04:36,243 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.056) 0:02:22.423 ******* >2018-08-30 12:04:36,271 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:36,286 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:04:36,287 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.043) 0:02:22.467 ******* >2018-08-30 12:04:36,313 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:36,327 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:04:36,327 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.040) 0:02:22.507 ******* >2018-08-30 12:04:36,354 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:36,367 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:04:36,367 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.040) 0:02:22.547 ******* >2018-08-30 12:04:36,393 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:36,407 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:04:36,407 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.039) 0:02:22.587 ******* >2018-08-30 12:04:36,437 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:36,450 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:04:36,450 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.043) 0:02:22.630 ******* >2018-08-30 12:04:36,507 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:36,521 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:04:36,521 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.070) 0:02:22.701 ******* >2018-08-30 12:04:36,577 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:36,590 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:04:36,591 p=7972 u=mistral | Thursday 30 August 2018 12:04:36 -0400 (0:00:00.069) 0:02:22.771 ******* >2018-08-30 12:04:36,945 p=7972 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:04:37,238 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/) >2018-08-30 12:04:37,683 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/mon) >2018-08-30 12:04:37,996 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/osd) >2018-08-30 12:04:38,316 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/mds) >2018-08-30 12:04:38,608 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/tmp) >2018-08-30 12:04:38,924 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:04:39,239 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:04:39,604 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:04:39,920 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:04:40,242 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:04:40,538 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:04:40,559 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:04:40,560 p=7972 u=mistral | Thursday 30 August 2018 12:04:40 -0400 (0:00:03.969) 0:02:26.740 ******* >2018-08-30 12:04:40,586 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:40,601 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:04:40,601 p=7972 u=mistral | Thursday 30 August 2018 12:04:40 -0400 (0:00:00.041) 0:02:26.781 ******* >2018-08-30 12:04:40,644 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:40,659 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:04:40,659 p=7972 u=mistral | Thursday 30 August 2018 12:04:40 -0400 (0:00:00.058) 0:02:26.839 ******* >2018-08-30 12:04:40,693 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:40,713 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:04:40,714 p=7972 u=mistral | Thursday 30 August 2018 12:04:40 -0400 (0:00:00.054) 0:02:26.894 ******* >2018-08-30 12:04:41,067 p=7972 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:04:41,528 p=7972 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:04:41,543 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:04:41,543 p=7972 u=mistral | Thursday 30 August 2018 12:04:41 -0400 (0:00:00.829) 0:02:27.724 ******* >2018-08-30 12:04:41,611 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:41,630 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:04:41,630 p=7972 u=mistral | Thursday 30 August 2018 12:04:41 -0400 (0:00:00.086) 0:02:27.810 ******* >2018-08-30 12:04:41,652 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:41,673 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:04:41,673 p=7972 u=mistral | Thursday 30 August 2018 12:04:41 -0400 (0:00:00.043) 0:02:27.853 ******* >2018-08-30 12:04:42,027 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:42,043 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:04:42,043 p=7972 u=mistral | Thursday 30 August 2018 12:04:42 -0400 (0:00:00.369) 0:02:28.223 ******* >2018-08-30 12:04:42,102 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:42,117 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:04:42,118 p=7972 u=mistral | Thursday 30 August 2018 12:04:42 -0400 (0:00:00.074) 0:02:28.298 ******* >2018-08-30 12:04:42,488 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:42,503 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:04:42,503 p=7972 u=mistral | Thursday 30 August 2018 12:04:42 -0400 (0:00:00.385) 0:02:28.683 ******* >2018-08-30 12:04:42,613 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:42,628 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:04:42,628 p=7972 u=mistral | Thursday 30 August 2018 12:04:42 -0400 (0:00:00.125) 0:02:28.808 ******* >2018-08-30 12:04:42,805 p=7972 u=mistral | ok: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:04:43,087 p=7972 u=mistral | ok: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:04:43,214 p=7972 u=mistral | ok: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:04:43,231 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:04:43,231 p=7972 u=mistral | Thursday 30 August 2018 12:04:43 -0400 (0:00:00.602) 0:02:29.411 ******* >2018-08-30 12:04:43,338 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:43,355 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:04:43,355 p=7972 u=mistral | Thursday 30 August 2018 12:04:43 -0400 (0:00:00.123) 0:02:29.535 ******* >2018-08-30 12:04:43,469 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:04:43,495 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:04:43,496 p=7972 u=mistral | Thursday 30 August 2018 12:04:43 -0400 (0:00:00.140) 0:02:29.676 ******* >2018-08-30 12:04:43,825 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:04:44,114 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/monmap-ceph) >2018-08-30 12:04:44,387 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:04:44,662 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:04:44,939 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:04:45,230 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:04:45,514 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:04:45,805 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller03.keyring) >2018-08-30 12:04:46,064 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller01.keyring) >2018-08-30 12:04:46,336 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller02.keyring) >2018-08-30 12:04:46,360 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:04:46,360 p=7972 u=mistral | Thursday 30 August 2018 12:04:46 -0400 (0:00:02.864) 0:02:32.541 ******* >2018-08-30 12:04:46,481 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,537 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/monmap-ceph', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/monmap-ceph', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/monmap-ceph', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,595 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,654 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645064.828, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,714 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645065.151, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,774 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645065.446, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,830 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,887 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mgr.lab-controller03.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,944 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mgr.lab-controller01.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:46,999 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mgr.lab-controller02.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:04:47,025 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:04:47,026 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.665) 0:02:33.206 ******* >2018-08-30 12:04:47,051 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,068 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:04:47,068 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.042) 0:02:33.249 ******* >2018-08-30 12:04:47,092 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,106 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:04:47,107 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.038) 0:02:33.287 ******* >2018-08-30 12:04:47,140 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,157 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:04:47,157 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.050) 0:02:33.337 ******* >2018-08-30 12:04:47,201 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,223 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:04:47,223 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.066) 0:02:33.403 ******* >2018-08-30 12:04:47,254 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,269 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:04:47,269 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.045) 0:02:33.449 ******* >2018-08-30 12:04:47,298 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,312 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:04:47,312 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.043) 0:02:33.492 ******* >2018-08-30 12:04:47,341 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,355 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:04:47,355 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.042) 0:02:33.535 ******* >2018-08-30 12:04:47,384 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,397 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:04:47,397 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.042) 0:02:33.577 ******* >2018-08-30 12:04:47,431 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,444 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:04:47,445 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.047) 0:02:33.625 ******* >2018-08-30 12:04:47,470 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,484 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:04:47,485 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.039) 0:02:33.665 ******* >2018-08-30 12:04:47,511 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,524 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:04:47,525 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.039) 0:02:33.705 ******* >2018-08-30 12:04:47,551 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,571 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:04:47,572 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.047) 0:02:33.752 ******* >2018-08-30 12:04:47,610 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,633 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:04:47,634 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.061) 0:02:33.814 ******* >2018-08-30 12:04:47,662 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,681 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:04:47,682 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.047) 0:02:33.862 ******* >2018-08-30 12:04:47,708 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,728 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:04:47,729 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.047) 0:02:33.909 ******* >2018-08-30 12:04:47,761 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,783 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:04:47,784 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.055) 0:02:33.964 ******* >2018-08-30 12:04:47,815 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,829 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:04:47,830 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.045) 0:02:34.010 ******* >2018-08-30 12:04:47,855 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,869 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:04:47,869 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.039) 0:02:34.049 ******* >2018-08-30 12:04:47,896 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,912 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:04:47,912 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.043) 0:02:34.092 ******* >2018-08-30 12:04:47,945 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:47,960 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:04:47,961 p=7972 u=mistral | Thursday 30 August 2018 12:04:47 -0400 (0:00:00.048) 0:02:34.141 ******* >2018-08-30 12:04:47,992 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,009 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:04:48,010 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.048) 0:02:34.190 ******* >2018-08-30 12:04:48,038 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,055 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:04:48,055 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.045) 0:02:34.235 ******* >2018-08-30 12:04:48,090 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,106 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:04:48,106 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.051) 0:02:34.286 ******* >2018-08-30 12:04:48,136 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,152 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:04:48,153 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.046) 0:02:34.333 ******* >2018-08-30 12:04:48,181 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,197 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:04:48,197 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.044) 0:02:34.377 ******* >2018-08-30 12:04:48,225 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,239 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:04:48,240 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.042) 0:02:34.420 ******* >2018-08-30 12:04:48,271 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,285 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:04:48,286 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.045) 0:02:34.466 ******* >2018-08-30 12:04:48,313 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,327 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:04:48,327 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.041) 0:02:34.508 ******* >2018-08-30 12:04:48,355 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:04:48,372 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:04:48,372 p=7972 u=mistral | Thursday 30 August 2018 12:04:48 -0400 (0:00:00.044) 0:02:34.552 ******* >2018-08-30 12:05:11,797 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:11,820 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:05:11,820 p=7972 u=mistral | Thursday 30 August 2018 12:05:11 -0400 (0:00:23.448) 0:02:58.000 ******* >2018-08-30 12:05:12,193 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:05:12,215 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:05:12,215 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.394) 0:02:58.395 ******* >2018-08-30 12:05:12,289 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:12,303 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:05:12,303 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.088) 0:02:58.483 ******* >2018-08-30 12:05:12,335 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,349 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:05:12,349 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.046) 0:02:58.529 ******* >2018-08-30 12:05:12,382 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,396 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:05:12,396 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.047) 0:02:58.577 ******* >2018-08-30 12:05:12,427 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,443 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:05:12,443 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.046) 0:02:58.623 ******* >2018-08-30 12:05:12,472 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,487 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:05:12,488 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.044) 0:02:58.668 ******* >2018-08-30 12:05:12,523 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,541 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:05:12,541 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.053) 0:02:58.721 ******* >2018-08-30 12:05:12,571 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,595 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:05:12,595 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.054) 0:02:58.776 ******* >2018-08-30 12:05:12,631 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,661 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:05:12,661 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.065) 0:02:58.841 ******* >2018-08-30 12:05:12,693 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,709 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:05:12,709 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.047) 0:02:58.889 ******* >2018-08-30 12:05:12,738 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,753 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:05:12,753 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.043) 0:02:58.933 ******* >2018-08-30 12:05:12,781 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,798 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:05:12,798 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.045) 0:02:58.979 ******* >2018-08-30 12:05:12,828 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:12,842 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:05:12,843 p=7972 u=mistral | Thursday 30 August 2018 12:05:12 -0400 (0:00:00.044) 0:02:59.023 ******* >2018-08-30 12:05:14,021 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:14,035 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:05:14,036 p=7972 u=mistral | Thursday 30 August 2018 12:05:14 -0400 (0:00:01.193) 0:03:00.216 ******* >2018-08-30 12:05:14,105 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:14,120 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:05:14,121 p=7972 u=mistral | Thursday 30 August 2018 12:05:14 -0400 (0:00:00.084) 0:03:00.301 ******* >2018-08-30 12:05:14,149 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:14,165 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:05:14,165 p=7972 u=mistral | Thursday 30 August 2018 12:05:14 -0400 (0:00:00.044) 0:03:00.345 ******* >2018-08-30 12:05:14,196 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:14,211 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:05:14,211 p=7972 u=mistral | Thursday 30 August 2018 12:05:14 -0400 (0:00:00.045) 0:03:00.391 ******* >2018-08-30 12:05:14,271 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:14,288 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:05:14,288 p=7972 u=mistral | Thursday 30 August 2018 12:05:14 -0400 (0:00:00.077) 0:03:00.468 ******* >2018-08-30 12:05:14,319 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:14,336 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:05:14,336 p=7972 u=mistral | Thursday 30 August 2018 12:05:14 -0400 (0:00:00.047) 0:03:00.516 ******* >2018-08-30 12:05:14,365 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:14,381 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:05:14,381 p=7972 u=mistral | Thursday 30 August 2018 12:05:14 -0400 (0:00:00.045) 0:03:00.561 ******* >2018-08-30 12:05:14,710 p=7972 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:05:15,164 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:05:15,468 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:05:15,931 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:05:16,305 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:05:16,323 p=7972 u=mistral | TASK [ceph-mon : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:05:16,323 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:01.942) 0:03:02.503 ******* >2018-08-30 12:05:16,389 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:16,406 p=7972 u=mistral | TASK [ceph-mon : make sure monitor_interface or monitor_address or monitor_address_block is configured] *** >2018-08-30 12:05:16,406 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.083) 0:03:02.586 ******* >2018-08-30 12:05:16,443 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,462 p=7972 u=mistral | TASK [ceph-mon : generate monitor initial keyring] ***************************** >2018-08-30 12:05:16,462 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.055) 0:03:02.642 ******* >2018-08-30 12:05:16,495 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,515 p=7972 u=mistral | TASK [ceph-mon : read monitor initial keyring if it already exists] ************ >2018-08-30 12:05:16,515 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.053) 0:03:02.696 ******* >2018-08-30 12:05:16,543 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,556 p=7972 u=mistral | TASK [ceph-mon : create monitor initial keyring] ******************************* >2018-08-30 12:05:16,556 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.040) 0:03:02.736 ******* >2018-08-30 12:05:16,587 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,610 p=7972 u=mistral | TASK [ceph-mon : set initial monitor key permissions] ************************** >2018-08-30 12:05:16,610 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.053) 0:03:02.790 ******* >2018-08-30 12:05:16,644 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,661 p=7972 u=mistral | TASK [ceph-mon : create (and fix ownership of) monitor directory] ************** >2018-08-30 12:05:16,662 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.051) 0:03:02.842 ******* >2018-08-30 12:05:16,693 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,710 p=7972 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap >= ceph_release_num.luminous] *** >2018-08-30 12:05:16,710 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.048) 0:03:02.890 ******* >2018-08-30 12:05:16,742 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,758 p=7972 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap < ceph_release_num.luminous] *** >2018-08-30 12:05:16,759 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.048) 0:03:02.939 ******* >2018-08-30 12:05:16,790 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,806 p=7972 u=mistral | TASK [ceph-mon : create custom admin keyring] ********************************** >2018-08-30 12:05:16,806 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.047) 0:03:02.986 ******* >2018-08-30 12:05:16,836 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,852 p=7972 u=mistral | TASK [ceph-mon : set ownership of admin keyring] ******************************* >2018-08-30 12:05:16,852 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.045) 0:03:03.032 ******* >2018-08-30 12:05:16,884 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,898 p=7972 u=mistral | TASK [ceph-mon : import admin keyring into mon keyring] ************************ >2018-08-30 12:05:16,899 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.046) 0:03:03.079 ******* >2018-08-30 12:05:16,930 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,948 p=7972 u=mistral | TASK [ceph-mon : ceph monitor mkfs with keyring] ******************************* >2018-08-30 12:05:16,948 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.049) 0:03:03.128 ******* >2018-08-30 12:05:16,977 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:16,992 p=7972 u=mistral | TASK [ceph-mon : ceph monitor mkfs without keyring] **************************** >2018-08-30 12:05:16,993 p=7972 u=mistral | Thursday 30 August 2018 12:05:16 -0400 (0:00:00.044) 0:03:03.173 ******* >2018-08-30 12:05:17,020 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:17,038 p=7972 u=mistral | TASK [ceph-mon : ensure systemd service override directory exists] ************* >2018-08-30 12:05:17,038 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.045) 0:03:03.218 ******* >2018-08-30 12:05:17,069 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:17,084 p=7972 u=mistral | TASK [ceph-mon : add ceph-mon systemd service overrides] *********************** >2018-08-30 12:05:17,084 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.046) 0:03:03.264 ******* >2018-08-30 12:05:17,114 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:17,134 p=7972 u=mistral | TASK [ceph-mon : start the monitor service] ************************************ >2018-08-30 12:05:17,134 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.049) 0:03:03.314 ******* >2018-08-30 12:05:17,165 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:17,180 p=7972 u=mistral | TASK [ceph-mon : enable the ceph-mon.target service] *************************** >2018-08-30 12:05:17,181 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.046) 0:03:03.361 ******* >2018-08-30 12:05:17,207 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:17,222 p=7972 u=mistral | TASK [ceph-mon : include ceph_keys.yml] **************************************** >2018-08-30 12:05:17,222 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.041) 0:03:03.403 ******* >2018-08-30 12:05:17,250 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:17,264 p=7972 u=mistral | TASK [ceph-mon : collect all the pools] **************************************** >2018-08-30 12:05:17,265 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.042) 0:03:03.445 ******* >2018-08-30 12:05:17,291 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:17,307 p=7972 u=mistral | TASK [ceph-mon : secure the cluster] ******************************************* >2018-08-30 12:05:17,307 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.042) 0:03:03.487 ******* >2018-08-30 12:05:17,357 p=7972 u=mistral | TASK [ceph-mon : set_fact ceph_config_keys] ************************************ >2018-08-30 12:05:17,357 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.049) 0:03:03.537 ******* >2018-08-30 12:05:17,435 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:17,450 p=7972 u=mistral | TASK [ceph-mon : register rbd bootstrap key] *********************************** >2018-08-30 12:05:17,450 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.093) 0:03:03.631 ******* >2018-08-30 12:05:17,526 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:17,542 p=7972 u=mistral | TASK [ceph-mon : merge rbd bootstrap key to config and keys paths] ************* >2018-08-30 12:05:17,542 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.091) 0:03:03.722 ******* >2018-08-30 12:05:17,614 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:17,642 p=7972 u=mistral | TASK [ceph-mon : stat for ceph config and keys] ******************************** >2018-08-30 12:05:17,642 p=7972 u=mistral | Thursday 30 August 2018 12:05:17 -0400 (0:00:00.100) 0:03:03.822 ******* >2018-08-30 12:05:17,935 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:05:18,151 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:05:18,388 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:05:18,597 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:05:18,809 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:05:19,030 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:05:19,052 p=7972 u=mistral | TASK [ceph-mon : try to copy ceph keys] **************************************** >2018-08-30 12:05:19,053 p=7972 u=mistral | Thursday 30 August 2018 12:05:19 -0400 (0:00:01.410) 0:03:05.233 ******* >2018-08-30 12:05:19,832 p=7972 u=mistral | ok: [172.16.0.24] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:19,864 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:20,686 p=7972 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:21,350 p=7972 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:22,053 p=7972 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:22,079 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:22,101 p=7972 u=mistral | TASK [ceph-mon : populate kv_store with default ceph.conf] ********************* >2018-08-30 12:05:22,101 p=7972 u=mistral | Thursday 30 August 2018 12:05:22 -0400 (0:00:03.048) 0:03:08.282 ******* >2018-08-30 12:05:22,124 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:05:22,133 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:22,148 p=7972 u=mistral | TASK [ceph-mon : populate kv_store with custom ceph.conf] ********************** >2018-08-30 12:05:22,148 p=7972 u=mistral | Thursday 30 August 2018 12:05:22 -0400 (0:00:00.046) 0:03:08.328 ******* >2018-08-30 12:05:22,170 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:05:22,179 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:22,193 p=7972 u=mistral | TASK [ceph-mon : delete populate-kv-store docker] ****************************** >2018-08-30 12:05:22,194 p=7972 u=mistral | Thursday 30 August 2018 12:05:22 -0400 (0:00:00.045) 0:03:08.374 ******* >2018-08-30 12:05:22,217 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:22,232 p=7972 u=mistral | TASK [ceph-mon : generate systemd unit file] *********************************** >2018-08-30 12:05:22,232 p=7972 u=mistral | Thursday 30 August 2018 12:05:22 -0400 (0:00:00.038) 0:03:08.412 ******* >2018-08-30 12:05:23,680 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:05:23,692 p=7972 u=mistral | TASK [ceph-mon : systemd start mon container] ********************************** >2018-08-30 12:05:23,692 p=7972 u=mistral | Thursday 30 August 2018 12:05:23 -0400 (0:00:01.459) 0:03:09.872 ******* >2018-08-30 12:05:24,646 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:05:24,663 p=7972 u=mistral | TASK [ceph-mon : configure ceph profile.d aliases] ***************************** >2018-08-30 12:05:24,664 p=7972 u=mistral | Thursday 30 August 2018 12:05:24 -0400 (0:00:00.971) 0:03:10.844 ******* >2018-08-30 12:05:25,897 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:05:25,912 p=7972 u=mistral | TASK [ceph-mon : wait for monitor socket to exist] ***************************** >2018-08-30 12:05:25,912 p=7972 u=mistral | Thursday 30 August 2018 12:05:25 -0400 (0:00:01.248) 0:03:12.092 ******* >2018-08-30 12:05:26,371 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:05:26,391 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:05:26,392 p=7972 u=mistral | Thursday 30 August 2018 12:05:26 -0400 (0:00:00.479) 0:03:12.572 ******* >2018-08-30 12:05:26,456 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:26,473 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:05:26,473 p=7972 u=mistral | Thursday 30 August 2018 12:05:26 -0400 (0:00:00.081) 0:03:12.653 ******* >2018-08-30 12:05:26,546 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:26,562 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:05:26,562 p=7972 u=mistral | Thursday 30 August 2018 12:05:26 -0400 (0:00:00.089) 0:03:12.742 ******* >2018-08-30 12:05:27,276 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:27,296 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:05:27,297 p=7972 u=mistral | Thursday 30 August 2018 12:05:27 -0400 (0:00:00.734) 0:03:13.477 ******* >2018-08-30 12:05:27,330 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:27,354 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:05:27,354 p=7972 u=mistral | Thursday 30 August 2018 12:05:27 -0400 (0:00:00.057) 0:03:13.535 ******* >2018-08-30 12:05:27,385 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:27,402 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:05:27,402 p=7972 u=mistral | Thursday 30 August 2018 12:05:27 -0400 (0:00:00.047) 0:03:13.582 ******* >2018-08-30 12:05:27,435 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:27,453 p=7972 u=mistral | TASK [ceph-mon : push ceph files to the ansible server] ************************ >2018-08-30 12:05:27,453 p=7972 u=mistral | Thursday 30 August 2018 12:05:27 -0400 (0:00:00.050) 0:03:13.633 ******* >2018-08-30 12:05:27,531 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:27,864 p=7972 u=mistral | ok: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:27,897 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:27,928 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:27,955 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:28,446 p=7972 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:28,468 p=7972 u=mistral | TASK [ceph-mon : create ceph rest api keyring when mon is containerized] ******* >2018-08-30 12:05:28,469 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:01.015) 0:03:14.649 ******* >2018-08-30 12:05:28,506 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:28,521 p=7972 u=mistral | TASK [ceph-mon : create ceph mgr keyring(s) when mon is containerized] ********* >2018-08-30 12:05:28,521 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:00.052) 0:03:14.702 ******* >2018-08-30 12:05:28,562 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:05:28,575 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:05:28,590 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:05:28,612 p=7972 u=mistral | TASK [ceph-mon : stat for ceph mgr key(s)] ************************************* >2018-08-30 12:05:28,612 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:00.090) 0:03:14.793 ******* >2018-08-30 12:05:28,661 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:05:28,682 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:05:28,697 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:05:28,715 p=7972 u=mistral | TASK [ceph-mon : fetch ceph mgr key(s)] **************************************** >2018-08-30 12:05:28,715 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:00.102) 0:03:14.895 ******* >2018-08-30 12:05:28,756 p=7972 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.33', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:05:28,769 p=7972 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.24', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:05:28,783 p=7972 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.25', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:05:28,799 p=7972 u=mistral | TASK [ceph-mon : configure crush hierarchy] ************************************ >2018-08-30 12:05:28,799 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:00.084) 0:03:14.979 ******* >2018-08-30 12:05:28,829 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.28) >2018-08-30 12:05:28,835 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.36) >2018-08-30 12:05:28,840 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.32) >2018-08-30 12:05:28,856 p=7972 u=mistral | TASK [ceph-mon : create configured crush rules] ******************************** >2018-08-30 12:05:28,856 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:00.057) 0:03:15.036 ******* >2018-08-30 12:05:28,900 p=7972 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:05:28,903 p=7972 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:05:28,920 p=7972 u=mistral | TASK [ceph-mon : get id for new default crush rule] **************************** >2018-08-30 12:05:28,921 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:00.064) 0:03:15.101 ******* >2018-08-30 12:05:28,961 p=7972 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:05:28,967 p=7972 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:05:28,987 p=7972 u=mistral | TASK [ceph-mon : set_fact info_ceph_default_crush_rule_yaml] ******************* >2018-08-30 12:05:28,987 p=7972 u=mistral | Thursday 30 August 2018 12:05:28 -0400 (0:00:00.066) 0:03:15.168 ******* >2018-08-30 12:05:29,024 p=7972 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'HDD', u'name': u'HDD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:05:29,029 p=7972 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'SSD', u'name': u'SSD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:05:29,055 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_crush_rule to osd_pool_default_crush_replicated_ruleset if release < luminous else osd_pool_default_crush_rule] *** >2018-08-30 12:05:29,056 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.068) 0:03:15.236 ******* >2018-08-30 12:05:29,083 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:29,151 p=7972 u=mistral | TASK [ceph-mon : insert new default crush rule into daemon to prevent restart] *** >2018-08-30 12:05:29,151 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.095) 0:03:15.331 ******* >2018-08-30 12:05:29,191 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:05:29,203 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:05:29,207 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:05:29,271 p=7972 u=mistral | TASK [ceph-mon : add new default crush rule to ceph.conf] ********************** >2018-08-30 12:05:29,271 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.120) 0:03:15.451 ******* >2018-08-30 12:05:29,320 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:05:29,325 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:05:29,332 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:05:29,348 p=7972 u=mistral | TASK [ceph-mon : get default value for osd_pool_default_pg_num] **************** >2018-08-30 12:05:29,348 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.076) 0:03:15.528 ******* >2018-08-30 12:05:29,387 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:29,403 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with pool_default_pg_num (backward compatibility)] *** >2018-08-30 12:05:29,403 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.055) 0:03:15.583 ******* >2018-08-30 12:05:29,435 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:29,450 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with default_pool_default_pg_num.stdout] *** >2018-08-30 12:05:29,450 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.047) 0:03:15.630 ******* >2018-08-30 12:05:29,484 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:29,501 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num ceph_conf_overrides.global.osd_pool_default_pg_num] *** >2018-08-30 12:05:29,501 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.050) 0:03:15.681 ******* >2018-08-30 12:05:29,576 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:29,594 p=7972 u=mistral | TASK [ceph-mon : increase calamari logging level when debug is on] ************* >2018-08-30 12:05:29,594 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.093) 0:03:15.774 ******* >2018-08-30 12:05:29,633 p=7972 u=mistral | skipping: [172.16.0.24] => (item=cthulhu) >2018-08-30 12:05:29,639 p=7972 u=mistral | skipping: [172.16.0.24] => (item=calamari_web) >2018-08-30 12:05:29,656 p=7972 u=mistral | TASK [ceph-mon : initialize the calamari server api] *************************** >2018-08-30 12:05:29,656 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.062) 0:03:15.837 ******* >2018-08-30 12:05:29,686 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:05:29,687 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:05:29,688 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.031) 0:03:15.868 ******* >2018-08-30 12:05:29,763 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:29,765 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:05:29,765 p=7972 u=mistral | Thursday 30 August 2018 12:05:29 -0400 (0:00:00.076) 0:03:15.945 ******* >2018-08-30 12:05:30,720 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:05:30,721 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:05:30,721 p=7972 u=mistral | Thursday 30 August 2018 12:05:30 -0400 (0:00:00.956) 0:03:16.901 ******* >2018-08-30 12:05:30,839 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:05:30,848 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:05:30,859 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:05:30,861 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:05:30,861 p=7972 u=mistral | Thursday 30 August 2018 12:05:30 -0400 (0:00:00.139) 0:03:17.041 ******* >2018-08-30 12:05:30,976 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:05:31,016 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:05:31,047 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:05:31,050 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:05:31,050 p=7972 u=mistral | Thursday 30 August 2018 12:05:31 -0400 (0:00:00.189) 0:03:17.230 ******* >2018-08-30 12:05:31,113 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:05:31,142 p=7972 u=mistral | TASK [non container | waiting for the monitor to join the quorum...] *********** >2018-08-30 12:05:31,142 p=7972 u=mistral | Thursday 30 August 2018 12:05:31 -0400 (0:00:00.091) 0:03:17.322 ******* >2018-08-30 12:05:31,887 p=7972 u=mistral | changed: [172.16.0.24 -> 172.16.0.25] >2018-08-30 12:05:31,903 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph mon] ************** >2018-08-30 12:05:32,025 p=7972 u=mistral | TASK [select a running monitor] ************************************************ >2018-08-30 12:05:32,026 p=7972 u=mistral | Thursday 30 August 2018 12:05:32 -0400 (0:00:00.883) 0:03:18.206 ******* >2018-08-30 12:05:32,251 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:05:32,271 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:05:32,277 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:05:32,291 p=7972 u=mistral | TASK [stop non-containerized ceph mon] ***************************************** >2018-08-30 12:05:32,292 p=7972 u=mistral | Thursday 30 August 2018 12:05:32 -0400 (0:00:00.265) 0:03:18.472 ******* >2018-08-30 12:05:33,113 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:05:33,129 p=7972 u=mistral | TASK [set_fact ceph_uid for ubuntu] ******************************************** >2018-08-30 12:05:33,130 p=7972 u=mistral | Thursday 30 August 2018 12:05:33 -0400 (0:00:00.837) 0:03:19.310 ******* >2018-08-30 12:05:33,326 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:33,337 p=7972 u=mistral | TASK [set_fact ceph_uid for red hat] ******************************************* >2018-08-30 12:05:33,338 p=7972 u=mistral | Thursday 30 August 2018 12:05:33 -0400 (0:00:00.207) 0:03:19.518 ******* >2018-08-30 12:05:33,366 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:33,379 p=7972 u=mistral | TASK [set_fact ceph_uid for rhel] ********************************************** >2018-08-30 12:05:33,379 p=7972 u=mistral | Thursday 30 August 2018 12:05:33 -0400 (0:00:00.041) 0:03:19.559 ******* >2018-08-30 12:05:33,441 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:33,456 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:05:33,456 p=7972 u=mistral | Thursday 30 August 2018 12:05:33 -0400 (0:00:00.077) 0:03:19.636 ******* >2018-08-30 12:05:33,863 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph) >2018-08-30 12:05:34,169 p=7972 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:05:34,188 p=7972 u=mistral | TASK [check for existing old leveldb file extension (ldb)] ********************* >2018-08-30 12:05:34,189 p=7972 u=mistral | Thursday 30 August 2018 12:05:34 -0400 (0:00:00.732) 0:03:20.369 ******* >2018-08-30 12:05:34,542 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:34,557 p=7972 u=mistral | TASK [rename leveldb extension from ldb to sst] ******************************** >2018-08-30 12:05:34,557 p=7972 u=mistral | Thursday 30 August 2018 12:05:34 -0400 (0:00:00.368) 0:03:20.737 ******* >2018-08-30 12:05:34,583 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:34,598 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:05:34,599 p=7972 u=mistral | Thursday 30 August 2018 12:05:34 -0400 (0:00:00.041) 0:03:20.779 ******* >2018-08-30 12:05:34,990 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:35,004 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:05:35,005 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.405) 0:03:21.185 ******* >2018-08-30 12:05:35,037 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,050 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:05:35,050 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.045) 0:03:21.230 ******* >2018-08-30 12:05:35,080 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,094 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:05:35,094 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.044) 0:03:21.275 ******* >2018-08-30 12:05:35,128 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,147 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:05:35,147 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.052) 0:03:21.327 ******* >2018-08-30 12:05:35,551 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:35,566 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:05:35,566 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.418) 0:03:21.746 ******* >2018-08-30 12:05:35,609 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,625 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:05:35,625 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.058) 0:03:21.805 ******* >2018-08-30 12:05:35,658 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,675 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:05:35,676 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.050) 0:03:21.856 ******* >2018-08-30 12:05:35,708 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,724 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:05:35,725 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.048) 0:03:21.905 ******* >2018-08-30 12:05:35,758 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,774 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:05:35,775 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.049) 0:03:21.955 ******* >2018-08-30 12:05:35,807 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,825 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:05:35,825 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.050) 0:03:22.006 ******* >2018-08-30 12:05:35,852 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,868 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:05:35,868 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.042) 0:03:22.049 ******* >2018-08-30 12:05:35,897 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,913 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:05:35,913 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.044) 0:03:22.093 ******* >2018-08-30 12:05:35,947 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:35,963 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:05:35,963 p=7972 u=mistral | Thursday 30 August 2018 12:05:35 -0400 (0:00:00.049) 0:03:22.143 ******* >2018-08-30 12:05:35,992 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,009 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:05:36,010 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.046) 0:03:22.190 ******* >2018-08-30 12:05:36,040 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,056 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:05:36,056 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.046) 0:03:22.236 ******* >2018-08-30 12:05:36,087 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,103 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:05:36,103 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.046) 0:03:22.283 ******* >2018-08-30 12:05:36,134 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,150 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:05:36,150 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.047) 0:03:22.330 ******* >2018-08-30 12:05:36,179 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,195 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:05:36,196 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.045) 0:03:22.376 ******* >2018-08-30 12:05:36,225 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,239 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:05:36,240 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.043) 0:03:22.420 ******* >2018-08-30 12:05:36,268 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,284 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:05:36,284 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.044) 0:03:22.464 ******* >2018-08-30 12:05:36,315 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,330 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:05:36,331 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.046) 0:03:22.511 ******* >2018-08-30 12:05:36,361 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,376 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:05:36,376 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.045) 0:03:22.556 ******* >2018-08-30 12:05:36,406 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,419 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:05:36,419 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.043) 0:03:22.600 ******* >2018-08-30 12:05:36,447 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,460 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:05:36,460 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.040) 0:03:22.640 ******* >2018-08-30 12:05:36,490 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,505 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:05:36,505 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.044) 0:03:22.685 ******* >2018-08-30 12:05:36,536 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,551 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:05:36,551 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.046) 0:03:22.731 ******* >2018-08-30 12:05:36,582 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,597 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:05:36,597 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.046) 0:03:22.777 ******* >2018-08-30 12:05:36,625 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:36,639 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:05:36,640 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.042) 0:03:22.820 ******* >2018-08-30 12:05:36,973 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:36,987 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:05:36,987 p=7972 u=mistral | Thursday 30 August 2018 12:05:36 -0400 (0:00:00.347) 0:03:23.167 ******* >2018-08-30 12:05:37,051 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:37,066 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:05:37,066 p=7972 u=mistral | Thursday 30 August 2018 12:05:37 -0400 (0:00:00.078) 0:03:23.246 ******* >2018-08-30 12:05:37,130 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:37,143 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:05:37,143 p=7972 u=mistral | Thursday 30 August 2018 12:05:37 -0400 (0:00:00.076) 0:03:23.323 ******* >2018-08-30 12:05:37,168 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:37,195 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:05:37,195 p=7972 u=mistral | Thursday 30 August 2018 12:05:37 -0400 (0:00:00.052) 0:03:23.376 ******* >2018-08-30 12:05:37,294 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:05:37,325 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:05:37,325 p=7972 u=mistral | Thursday 30 August 2018 12:05:37 -0400 (0:00:00.129) 0:03:23.505 ******* >2018-08-30 12:05:42,684 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:05:42,703 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:05:42,704 p=7972 u=mistral | Thursday 30 August 2018 12:05:42 -0400 (0:00:05.378) 0:03:28.884 ******* >2018-08-30 12:05:42,936 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:05:42,951 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:05:42,952 p=7972 u=mistral | Thursday 30 August 2018 12:05:42 -0400 (0:00:00.247) 0:03:29.132 ******* >2018-08-30 12:05:42,984 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:43,014 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:05:43,014 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.062) 0:03:29.195 ******* >2018-08-30 12:05:43,301 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:05:43,317 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:05:43,317 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.302) 0:03:29.497 ******* >2018-08-30 12:05:43,355 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:43,372 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:05:43,372 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.054) 0:03:29.552 ******* >2018-08-30 12:05:43,437 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:43,455 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:05:43,456 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.083) 0:03:29.636 ******* >2018-08-30 12:05:43,479 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:43,498 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:05:43,498 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.042) 0:03:29.678 ******* >2018-08-30 12:05:43,525 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:43,542 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:05:43,542 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.043) 0:03:29.722 ******* >2018-08-30 12:05:43,565 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:43,578 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:05:43,578 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.036) 0:03:29.759 ******* >2018-08-30 12:05:43,600 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:43,614 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:05:43,614 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.035) 0:03:29.794 ******* >2018-08-30 12:05:43,671 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:43,684 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:05:43,684 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.070) 0:03:29.864 ******* >2018-08-30 12:05:43,704 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:43,718 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:05:43,719 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.034) 0:03:29.899 ******* >2018-08-30 12:05:43,778 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:43,792 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:05:43,792 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.073) 0:03:29.972 ******* >2018-08-30 12:05:43,855 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:43,880 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:05:43,880 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.088) 0:03:30.060 ******* >2018-08-30 12:05:43,963 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:43,983 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:05:43,983 p=7972 u=mistral | Thursday 30 August 2018 12:05:43 -0400 (0:00:00.102) 0:03:30.163 ******* >2018-08-30 12:05:44,023 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/dev/vdb) >2018-08-30 12:05:44,038 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:05:44,039 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.055) 0:03:30.219 ******* >2018-08-30 12:05:44,082 p=7972 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:05:44,098 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:05:44,098 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.059) 0:03:30.278 ******* >2018-08-30 12:05:44,126 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:44,143 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:05:44,143 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.044) 0:03:30.323 ******* >2018-08-30 12:05:44,171 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:44,186 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:05:44,186 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.043) 0:03:30.366 ******* >2018-08-30 12:05:44,213 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:44,227 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:05:44,228 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.041) 0:03:30.408 ******* >2018-08-30 12:05:44,258 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:44,274 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:05:44,274 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.046) 0:03:30.454 ******* >2018-08-30 12:05:44,304 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:44,319 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:05:44,320 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.045) 0:03:30.500 ******* >2018-08-30 12:05:44,390 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:44,407 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:05:44,407 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.087) 0:03:30.588 ******* >2018-08-30 12:05:44,471 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:44,486 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:05:44,487 p=7972 u=mistral | Thursday 30 August 2018 12:05:44 -0400 (0:00:00.079) 0:03:30.667 ******* >2018-08-30 12:05:44,837 p=7972 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:05:45,143 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/) >2018-08-30 12:05:45,440 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/mon) >2018-08-30 12:05:45,793 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/osd) >2018-08-30 12:05:46,104 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/mds) >2018-08-30 12:05:46,396 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/tmp) >2018-08-30 12:05:46,719 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:05:47,005 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:05:47,291 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:05:47,656 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:05:47,967 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:05:48,274 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:05:48,301 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:05:48,301 p=7972 u=mistral | Thursday 30 August 2018 12:05:48 -0400 (0:00:03.814) 0:03:34.481 ******* >2018-08-30 12:05:48,330 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:48,351 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:05:48,351 p=7972 u=mistral | Thursday 30 August 2018 12:05:48 -0400 (0:00:00.050) 0:03:34.531 ******* >2018-08-30 12:05:48,394 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:48,416 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:05:48,416 p=7972 u=mistral | Thursday 30 August 2018 12:05:48 -0400 (0:00:00.064) 0:03:34.596 ******* >2018-08-30 12:05:48,446 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:48,460 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:05:48,461 p=7972 u=mistral | Thursday 30 August 2018 12:05:48 -0400 (0:00:00.044) 0:03:34.641 ******* >2018-08-30 12:05:48,818 p=7972 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:05:49,119 p=7972 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:05:49,137 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:05:49,138 p=7972 u=mistral | Thursday 30 August 2018 12:05:49 -0400 (0:00:00.677) 0:03:35.318 ******* >2018-08-30 12:05:49,207 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:49,223 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:05:49,223 p=7972 u=mistral | Thursday 30 August 2018 12:05:49 -0400 (0:00:00.085) 0:03:35.403 ******* >2018-08-30 12:05:49,249 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:49,263 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:05:49,263 p=7972 u=mistral | Thursday 30 August 2018 12:05:49 -0400 (0:00:00.039) 0:03:35.443 ******* >2018-08-30 12:05:49,641 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:49,654 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:05:49,655 p=7972 u=mistral | Thursday 30 August 2018 12:05:49 -0400 (0:00:00.391) 0:03:35.835 ******* >2018-08-30 12:05:49,716 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:49,729 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:05:49,730 p=7972 u=mistral | Thursday 30 August 2018 12:05:49 -0400 (0:00:00.075) 0:03:35.910 ******* >2018-08-30 12:05:50,086 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:50,101 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:05:50,101 p=7972 u=mistral | Thursday 30 August 2018 12:05:50 -0400 (0:00:00.371) 0:03:36.281 ******* >2018-08-30 12:05:50,208 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:50,223 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:05:50,224 p=7972 u=mistral | Thursday 30 August 2018 12:05:50 -0400 (0:00:00.122) 0:03:36.404 ******* >2018-08-30 12:05:50,400 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:05:50,526 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:05:50,649 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:05:50,666 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:05:50,666 p=7972 u=mistral | Thursday 30 August 2018 12:05:50 -0400 (0:00:00.442) 0:03:36.846 ******* >2018-08-30 12:05:50,780 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:50,795 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:05:50,795 p=7972 u=mistral | Thursday 30 August 2018 12:05:50 -0400 (0:00:00.129) 0:03:36.975 ******* >2018-08-30 12:05:50,907 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:05:50,928 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:05:50,928 p=7972 u=mistral | Thursday 30 August 2018 12:05:50 -0400 (0:00:00.132) 0:03:37.108 ******* >2018-08-30 12:05:51,226 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:05:51,508 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/monmap-ceph) >2018-08-30 12:05:51,796 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:05:52,063 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:05:52,334 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:05:52,607 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:05:52,875 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:05:53,178 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller03.keyring) >2018-08-30 12:05:53,448 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller01.keyring) >2018-08-30 12:05:53,744 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller02.keyring) >2018-08-30 12:05:53,766 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:05:53,767 p=7972 u=mistral | Thursday 30 August 2018 12:05:53 -0400 (0:00:02.838) 0:03:39.947 ******* >2018-08-30 12:05:53,884 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:53,944 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/monmap-ceph', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/monmap-ceph', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/monmap-ceph', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,008 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,075 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,139 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,201 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,262 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,323 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mgr.lab-controller03.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,380 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mgr.lab-controller01.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,441 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mgr.lab-controller02.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:05:54,465 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:05:54,466 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.699) 0:03:40.646 ******* >2018-08-30 12:05:54,491 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,508 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:05:54,508 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.041) 0:03:40.688 ******* >2018-08-30 12:05:54,532 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,547 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:05:54,547 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.039) 0:03:40.727 ******* >2018-08-30 12:05:54,582 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,596 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:05:54,596 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.049) 0:03:40.776 ******* >2018-08-30 12:05:54,630 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,644 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:05:54,644 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.047) 0:03:40.825 ******* >2018-08-30 12:05:54,680 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,694 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:05:54,694 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.049) 0:03:40.874 ******* >2018-08-30 12:05:54,723 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,740 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:05:54,741 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.046) 0:03:40.921 ******* >2018-08-30 12:05:54,773 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,790 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:05:54,790 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.049) 0:03:40.971 ******* >2018-08-30 12:05:54,823 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,837 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:05:54,837 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.047) 0:03:41.018 ******* >2018-08-30 12:05:54,878 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,893 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:05:54,894 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.056) 0:03:41.074 ******* >2018-08-30 12:05:54,924 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,938 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:05:54,938 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.044) 0:03:41.119 ******* >2018-08-30 12:05:54,970 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:54,986 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:05:54,986 p=7972 u=mistral | Thursday 30 August 2018 12:05:54 -0400 (0:00:00.047) 0:03:41.166 ******* >2018-08-30 12:05:55,017 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,032 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:05:55,032 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.046) 0:03:41.213 ******* >2018-08-30 12:05:55,074 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,089 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:05:55,089 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.056) 0:03:41.269 ******* >2018-08-30 12:05:55,116 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,130 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:05:55,131 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.041) 0:03:41.311 ******* >2018-08-30 12:05:55,157 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,172 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:05:55,172 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.041) 0:03:41.352 ******* >2018-08-30 12:05:55,204 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,218 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:05:55,218 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.046) 0:03:41.399 ******* >2018-08-30 12:05:55,247 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,263 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:05:55,263 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.044) 0:03:41.444 ******* >2018-08-30 12:05:55,293 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,307 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:05:55,307 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.043) 0:03:41.487 ******* >2018-08-30 12:05:55,333 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,347 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:05:55,348 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.040) 0:03:41.528 ******* >2018-08-30 12:05:55,380 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,396 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:05:55,396 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.048) 0:03:41.576 ******* >2018-08-30 12:05:55,427 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,442 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:05:55,443 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.046) 0:03:41.623 ******* >2018-08-30 12:05:55,472 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,487 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:05:55,488 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.045) 0:03:41.668 ******* >2018-08-30 12:05:55,519 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,534 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:05:55,535 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.046) 0:03:41.715 ******* >2018-08-30 12:05:55,565 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,580 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:05:55,581 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.045) 0:03:41.761 ******* >2018-08-30 12:05:55,608 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,622 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:05:55,622 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.041) 0:03:41.802 ******* >2018-08-30 12:05:55,649 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,664 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:05:55,664 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.041) 0:03:41.844 ******* >2018-08-30 12:05:55,697 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,710 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:05:55,711 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.046) 0:03:41.891 ******* >2018-08-30 12:05:55,744 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,758 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:05:55,758 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.047) 0:03:41.938 ******* >2018-08-30 12:05:55,786 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:05:55,802 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:05:55,802 p=7972 u=mistral | Thursday 30 August 2018 12:05:55 -0400 (0:00:00.043) 0:03:41.982 ******* >2018-08-30 12:06:19,248 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:19,276 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:06:19,277 p=7972 u=mistral | Thursday 30 August 2018 12:06:19 -0400 (0:00:23.474) 0:04:05.457 ******* >2018-08-30 12:06:19,695 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:06:19,719 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:06:19,719 p=7972 u=mistral | Thursday 30 August 2018 12:06:19 -0400 (0:00:00.442) 0:04:05.900 ******* >2018-08-30 12:06:19,787 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:19,801 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:06:19,802 p=7972 u=mistral | Thursday 30 August 2018 12:06:19 -0400 (0:00:00.082) 0:04:05.982 ******* >2018-08-30 12:06:19,836 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:19,852 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:06:19,853 p=7972 u=mistral | Thursday 30 August 2018 12:06:19 -0400 (0:00:00.050) 0:04:06.033 ******* >2018-08-30 12:06:19,887 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:19,903 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:06:19,904 p=7972 u=mistral | Thursday 30 August 2018 12:06:19 -0400 (0:00:00.050) 0:04:06.084 ******* >2018-08-30 12:06:19,929 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:19,946 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:06:19,947 p=7972 u=mistral | Thursday 30 August 2018 12:06:19 -0400 (0:00:00.042) 0:04:06.127 ******* >2018-08-30 12:06:19,974 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:19,997 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:06:19,997 p=7972 u=mistral | Thursday 30 August 2018 12:06:19 -0400 (0:00:00.050) 0:04:06.177 ******* >2018-08-30 12:06:20,031 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:20,046 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:06:20,047 p=7972 u=mistral | Thursday 30 August 2018 12:06:20 -0400 (0:00:00.049) 0:04:06.227 ******* >2018-08-30 12:06:20,079 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:20,094 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:06:20,094 p=7972 u=mistral | Thursday 30 August 2018 12:06:20 -0400 (0:00:00.047) 0:04:06.274 ******* >2018-08-30 12:06:20,125 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:20,145 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:06:20,145 p=7972 u=mistral | Thursday 30 August 2018 12:06:20 -0400 (0:00:00.051) 0:04:06.326 ******* >2018-08-30 12:06:20,173 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:20,187 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:06:20,188 p=7972 u=mistral | Thursday 30 August 2018 12:06:20 -0400 (0:00:00.042) 0:04:06.368 ******* >2018-08-30 12:06:20,217 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:20,232 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:06:20,232 p=7972 u=mistral | Thursday 30 August 2018 12:06:20 -0400 (0:00:00.044) 0:04:06.412 ******* >2018-08-30 12:06:20,261 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:20,275 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:06:20,276 p=7972 u=mistral | Thursday 30 August 2018 12:06:20 -0400 (0:00:00.043) 0:04:06.456 ******* >2018-08-30 12:06:20,307 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:20,322 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:06:20,323 p=7972 u=mistral | Thursday 30 August 2018 12:06:20 -0400 (0:00:00.047) 0:04:06.503 ******* >2018-08-30 12:06:21,503 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:21,517 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:06:21,518 p=7972 u=mistral | Thursday 30 August 2018 12:06:21 -0400 (0:00:01.194) 0:04:07.698 ******* >2018-08-30 12:06:21,595 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:21,610 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:06:21,610 p=7972 u=mistral | Thursday 30 August 2018 12:06:21 -0400 (0:00:00.092) 0:04:07.791 ******* >2018-08-30 12:06:21,645 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:21,660 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:06:21,660 p=7972 u=mistral | Thursday 30 August 2018 12:06:21 -0400 (0:00:00.049) 0:04:07.840 ******* >2018-08-30 12:06:21,692 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:21,718 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:06:21,719 p=7972 u=mistral | Thursday 30 August 2018 12:06:21 -0400 (0:00:00.058) 0:04:07.899 ******* >2018-08-30 12:06:21,785 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:21,802 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:06:21,802 p=7972 u=mistral | Thursday 30 August 2018 12:06:21 -0400 (0:00:00.083) 0:04:07.982 ******* >2018-08-30 12:06:21,833 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:21,848 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:06:21,848 p=7972 u=mistral | Thursday 30 August 2018 12:06:21 -0400 (0:00:00.045) 0:04:08.028 ******* >2018-08-30 12:06:21,878 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:21,892 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:06:21,892 p=7972 u=mistral | Thursday 30 August 2018 12:06:21 -0400 (0:00:00.044) 0:04:08.073 ******* >2018-08-30 12:06:22,235 p=7972 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:06:22,544 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:06:22,843 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:06:23,124 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:06:23,618 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:06:23,636 p=7972 u=mistral | TASK [ceph-mon : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:06:23,636 p=7972 u=mistral | Thursday 30 August 2018 12:06:23 -0400 (0:00:01.743) 0:04:09.816 ******* >2018-08-30 12:06:23,698 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:23,714 p=7972 u=mistral | TASK [ceph-mon : make sure monitor_interface or monitor_address or monitor_address_block is configured] *** >2018-08-30 12:06:23,714 p=7972 u=mistral | Thursday 30 August 2018 12:06:23 -0400 (0:00:00.077) 0:04:09.894 ******* >2018-08-30 12:06:23,758 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:23,777 p=7972 u=mistral | TASK [ceph-mon : generate monitor initial keyring] ***************************** >2018-08-30 12:06:23,778 p=7972 u=mistral | Thursday 30 August 2018 12:06:23 -0400 (0:00:00.063) 0:04:09.958 ******* >2018-08-30 12:06:23,810 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:23,832 p=7972 u=mistral | TASK [ceph-mon : read monitor initial keyring if it already exists] ************ >2018-08-30 12:06:23,832 p=7972 u=mistral | Thursday 30 August 2018 12:06:23 -0400 (0:00:00.054) 0:04:10.012 ******* >2018-08-30 12:06:23,864 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:23,879 p=7972 u=mistral | TASK [ceph-mon : create monitor initial keyring] ******************************* >2018-08-30 12:06:23,879 p=7972 u=mistral | Thursday 30 August 2018 12:06:23 -0400 (0:00:00.046) 0:04:10.059 ******* >2018-08-30 12:06:23,911 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:23,928 p=7972 u=mistral | TASK [ceph-mon : set initial monitor key permissions] ************************** >2018-08-30 12:06:23,929 p=7972 u=mistral | Thursday 30 August 2018 12:06:23 -0400 (0:00:00.049) 0:04:10.109 ******* >2018-08-30 12:06:23,959 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:23,975 p=7972 u=mistral | TASK [ceph-mon : create (and fix ownership of) monitor directory] ************** >2018-08-30 12:06:23,975 p=7972 u=mistral | Thursday 30 August 2018 12:06:23 -0400 (0:00:00.046) 0:04:10.155 ******* >2018-08-30 12:06:24,009 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,027 p=7972 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap >= ceph_release_num.luminous] *** >2018-08-30 12:06:24,027 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.052) 0:04:10.207 ******* >2018-08-30 12:06:24,061 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,076 p=7972 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap < ceph_release_num.luminous] *** >2018-08-30 12:06:24,076 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.048) 0:04:10.256 ******* >2018-08-30 12:06:24,107 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,121 p=7972 u=mistral | TASK [ceph-mon : create custom admin keyring] ********************************** >2018-08-30 12:06:24,121 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.044) 0:04:10.301 ******* >2018-08-30 12:06:24,151 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,168 p=7972 u=mistral | TASK [ceph-mon : set ownership of admin keyring] ******************************* >2018-08-30 12:06:24,168 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.047) 0:04:10.348 ******* >2018-08-30 12:06:24,195 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,213 p=7972 u=mistral | TASK [ceph-mon : import admin keyring into mon keyring] ************************ >2018-08-30 12:06:24,213 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.045) 0:04:10.393 ******* >2018-08-30 12:06:24,244 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,260 p=7972 u=mistral | TASK [ceph-mon : ceph monitor mkfs with keyring] ******************************* >2018-08-30 12:06:24,260 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.047) 0:04:10.441 ******* >2018-08-30 12:06:24,293 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,310 p=7972 u=mistral | TASK [ceph-mon : ceph monitor mkfs without keyring] **************************** >2018-08-30 12:06:24,310 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.049) 0:04:10.490 ******* >2018-08-30 12:06:24,341 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,357 p=7972 u=mistral | TASK [ceph-mon : ensure systemd service override directory exists] ************* >2018-08-30 12:06:24,357 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.047) 0:04:10.537 ******* >2018-08-30 12:06:24,389 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,404 p=7972 u=mistral | TASK [ceph-mon : add ceph-mon systemd service overrides] *********************** >2018-08-30 12:06:24,405 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.047) 0:04:10.585 ******* >2018-08-30 12:06:24,436 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,452 p=7972 u=mistral | TASK [ceph-mon : start the monitor service] ************************************ >2018-08-30 12:06:24,453 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.047) 0:04:10.633 ******* >2018-08-30 12:06:24,484 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,502 p=7972 u=mistral | TASK [ceph-mon : enable the ceph-mon.target service] *************************** >2018-08-30 12:06:24,502 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.049) 0:04:10.682 ******* >2018-08-30 12:06:24,534 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,550 p=7972 u=mistral | TASK [ceph-mon : include ceph_keys.yml] **************************************** >2018-08-30 12:06:24,550 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.047) 0:04:10.730 ******* >2018-08-30 12:06:24,581 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,596 p=7972 u=mistral | TASK [ceph-mon : collect all the pools] **************************************** >2018-08-30 12:06:24,596 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.045) 0:04:10.776 ******* >2018-08-30 12:06:24,620 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:24,637 p=7972 u=mistral | TASK [ceph-mon : secure the cluster] ******************************************* >2018-08-30 12:06:24,637 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.041) 0:04:10.817 ******* >2018-08-30 12:06:24,688 p=7972 u=mistral | TASK [ceph-mon : set_fact ceph_config_keys] ************************************ >2018-08-30 12:06:24,689 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.051) 0:04:10.869 ******* >2018-08-30 12:06:24,766 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:24,786 p=7972 u=mistral | TASK [ceph-mon : register rbd bootstrap key] *********************************** >2018-08-30 12:06:24,787 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.098) 0:04:10.967 ******* >2018-08-30 12:06:24,863 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:24,881 p=7972 u=mistral | TASK [ceph-mon : merge rbd bootstrap key to config and keys paths] ************* >2018-08-30 12:06:24,882 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.094) 0:04:11.062 ******* >2018-08-30 12:06:24,960 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:24,999 p=7972 u=mistral | TASK [ceph-mon : stat for ceph config and keys] ******************************** >2018-08-30 12:06:24,999 p=7972 u=mistral | Thursday 30 August 2018 12:06:24 -0400 (0:00:00.117) 0:04:11.179 ******* >2018-08-30 12:06:25,299 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:06:25,521 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:06:25,749 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:06:25,969 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:06:26,201 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:06:26,421 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:06:26,444 p=7972 u=mistral | TASK [ceph-mon : try to copy ceph keys] **************************************** >2018-08-30 12:06:26,444 p=7972 u=mistral | Thursday 30 August 2018 12:06:26 -0400 (0:00:01.444) 0:04:12.624 ******* >2018-08-30 12:06:27,241 p=7972 u=mistral | ok: [172.16.0.25] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:27,269 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:27,974 p=7972 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:28,746 p=7972 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:29,471 p=7972 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:29,501 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:29,524 p=7972 u=mistral | TASK [ceph-mon : populate kv_store with default ceph.conf] ********************* >2018-08-30 12:06:29,524 p=7972 u=mistral | Thursday 30 August 2018 12:06:29 -0400 (0:00:03.079) 0:04:15.705 ******* >2018-08-30 12:06:29,548 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:06:29,558 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:29,576 p=7972 u=mistral | TASK [ceph-mon : populate kv_store with custom ceph.conf] ********************** >2018-08-30 12:06:29,577 p=7972 u=mistral | Thursday 30 August 2018 12:06:29 -0400 (0:00:00.052) 0:04:15.757 ******* >2018-08-30 12:06:29,608 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:06:29,620 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:29,645 p=7972 u=mistral | TASK [ceph-mon : delete populate-kv-store docker] ****************************** >2018-08-30 12:06:29,646 p=7972 u=mistral | Thursday 30 August 2018 12:06:29 -0400 (0:00:00.068) 0:04:15.826 ******* >2018-08-30 12:06:29,683 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:29,699 p=7972 u=mistral | TASK [ceph-mon : generate systemd unit file] *********************************** >2018-08-30 12:06:29,699 p=7972 u=mistral | Thursday 30 August 2018 12:06:29 -0400 (0:00:00.053) 0:04:15.879 ******* >2018-08-30 12:06:31,024 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:06:31,035 p=7972 u=mistral | TASK [ceph-mon : systemd start mon container] ********************************** >2018-08-30 12:06:31,036 p=7972 u=mistral | Thursday 30 August 2018 12:06:31 -0400 (0:00:01.336) 0:04:17.216 ******* >2018-08-30 12:06:32,025 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:06:32,041 p=7972 u=mistral | TASK [ceph-mon : configure ceph profile.d aliases] ***************************** >2018-08-30 12:06:32,041 p=7972 u=mistral | Thursday 30 August 2018 12:06:32 -0400 (0:00:01.005) 0:04:18.222 ******* >2018-08-30 12:06:33,028 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:06:33,046 p=7972 u=mistral | TASK [ceph-mon : wait for monitor socket to exist] ***************************** >2018-08-30 12:06:33,046 p=7972 u=mistral | Thursday 30 August 2018 12:06:33 -0400 (0:00:01.004) 0:04:19.226 ******* >2018-08-30 12:06:33,661 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:06:33,677 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:06:33,677 p=7972 u=mistral | Thursday 30 August 2018 12:06:33 -0400 (0:00:00.630) 0:04:19.857 ******* >2018-08-30 12:06:33,738 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:33,756 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:06:33,757 p=7972 u=mistral | Thursday 30 August 2018 12:06:33 -0400 (0:00:00.079) 0:04:19.937 ******* >2018-08-30 12:06:33,824 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:33,838 p=7972 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:06:33,838 p=7972 u=mistral | Thursday 30 August 2018 12:06:33 -0400 (0:00:00.081) 0:04:20.019 ******* >2018-08-30 12:06:34,485 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:34,505 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:06:34,506 p=7972 u=mistral | Thursday 30 August 2018 12:06:34 -0400 (0:00:00.667) 0:04:20.686 ******* >2018-08-30 12:06:34,542 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:34,558 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:06:34,558 p=7972 u=mistral | Thursday 30 August 2018 12:06:34 -0400 (0:00:00.052) 0:04:20.738 ******* >2018-08-30 12:06:34,590 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:34,605 p=7972 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:06:34,605 p=7972 u=mistral | Thursday 30 August 2018 12:06:34 -0400 (0:00:00.047) 0:04:20.785 ******* >2018-08-30 12:06:34,639 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:34,661 p=7972 u=mistral | TASK [ceph-mon : push ceph files to the ansible server] ************************ >2018-08-30 12:06:34,661 p=7972 u=mistral | Thursday 30 August 2018 12:06:34 -0400 (0:00:00.055) 0:04:20.841 ******* >2018-08-30 12:06:34,735 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:35,046 p=7972 u=mistral | ok: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:35,083 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:35,113 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:35,138 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:35,451 p=7972 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:06:35,472 p=7972 u=mistral | TASK [ceph-mon : create ceph rest api keyring when mon is containerized] ******* >2018-08-30 12:06:35,473 p=7972 u=mistral | Thursday 30 August 2018 12:06:35 -0400 (0:00:00.811) 0:04:21.653 ******* >2018-08-30 12:06:35,504 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:35,523 p=7972 u=mistral | TASK [ceph-mon : create ceph mgr keyring(s) when mon is containerized] ********* >2018-08-30 12:06:35,523 p=7972 u=mistral | Thursday 30 August 2018 12:06:35 -0400 (0:00:00.050) 0:04:21.703 ******* >2018-08-30 12:06:35,599 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ groups.get(mgr_group_name, []) | length > 0 >}} > >2018-08-30 12:06:36,522 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:06:37,442 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:06:38,386 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:06:38,401 p=7972 u=mistral | TASK [ceph-mon : stat for ceph mgr key(s)] ************************************* >2018-08-30 12:06:38,402 p=7972 u=mistral | Thursday 30 August 2018 12:06:38 -0400 (0:00:02.878) 0:04:24.582 ******* >2018-08-30 12:06:38,489 p=7972 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ groups.get(mgr_group_name, []) | length > 0 >}} > >2018-08-30 12:06:38,817 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:06:39,181 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:06:39,551 p=7972 u=mistral | ok: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:06:39,570 p=7972 u=mistral | TASK [ceph-mon : fetch ceph mgr key(s)] **************************************** >2018-08-30 12:06:39,570 p=7972 u=mistral | Thursday 30 August 2018 12:06:39 -0400 (0:00:01.168) 0:04:25.751 ******* >2018-08-30 12:06:39,979 p=7972 u=mistral | changed: [172.16.0.25] => (item={'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 0, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645197.445037, u'block_size': 4096, u'inode': 9761784, u'isgid': False, u'size': 71, u'executable': False, u'roth': True, u'charset': u'us-ascii', u'readable': True, u'version': u'18446744072996246998', u'pw_name': u'root', u'gid': 0, u'ischr': False, u'wusr': True, u'writeable': False, u'isdir': False, u'blocks': 8, u'xoth': False, u'rusr': True, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'root', u'path': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'xusr': False, u'atime': 1535645197.2690368, u'md5': u'855b52e842439169d0faee60df11c0de', u'mimetype': u'text/plain', u'ctime': 1535645197.445037, u'isblk': False, u'xgrp': False, u'dev': 64514, u'wgrp': False, u'isfifo': False, u'mode': u'0644', u'checksum': u'14c1cb46b68d2b51f1dfa491346254a203cb0ff1', u'islnk': False, u'attributes': []}, u'changed': False, '_ansible_no_log': False, 'item': u'172.16.0.33', '_ansible_item_result': True, 'failed': False, u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None}) >2018-08-30 12:06:40,331 p=7972 u=mistral | changed: [172.16.0.25] => (item={'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 0, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645198.3670366, u'block_size': 4096, u'inode': 9761786, u'isgid': False, u'size': 71, u'executable': False, u'roth': True, u'charset': u'us-ascii', u'readable': True, u'version': u'18446744073190735003', u'pw_name': u'root', u'gid': 0, u'ischr': False, u'wusr': True, u'writeable': False, u'isdir': False, u'blocks': 8, u'xoth': False, u'rusr': True, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'root', u'path': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'xusr': False, u'atime': 1535645198.2010367, u'md5': u'766ce60e91448f0c196c1303c2d6a7c4', u'mimetype': u'text/plain', u'ctime': 1535645198.3670366, u'isblk': False, u'xgrp': False, u'dev': 64514, u'wgrp': False, u'isfifo': False, u'mode': u'0644', u'checksum': u'42599b981d04addb5046bb792a7d4bd1f767ab8b', u'islnk': False, u'attributes': []}, u'changed': False, '_ansible_no_log': False, 'item': u'172.16.0.24', '_ansible_item_result': True, 'failed': False, u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None}) >2018-08-30 12:06:40,686 p=7972 u=mistral | changed: [172.16.0.25] => (item={'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 0, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645199.3110363, u'block_size': 4096, u'inode': 9761787, u'isgid': False, u'size': 71, u'executable': False, u'roth': True, u'charset': u'us-ascii', u'readable': True, u'version': u'18446744072485702171', u'pw_name': u'root', u'gid': 0, u'ischr': False, u'wusr': True, u'writeable': False, u'isdir': False, u'blocks': 8, u'xoth': False, u'rusr': True, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'root', u'path': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'xusr': False, u'atime': 1535645199.1480365, u'md5': u'516246c66efdfb30f97b8e6819caa58e', u'mimetype': u'text/plain', u'ctime': 1535645199.3110363, u'isblk': False, u'xgrp': False, u'dev': 64514, u'wgrp': False, u'isfifo': False, u'mode': u'0644', u'checksum': u'2697a3cfce227670e9c71655817435acb758f3a6', u'islnk': False, u'attributes': []}, u'changed': False, '_ansible_no_log': False, 'item': u'172.16.0.25', '_ansible_item_result': True, 'failed': False, u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None}) >2018-08-30 12:06:40,704 p=7972 u=mistral | TASK [ceph-mon : configure crush hierarchy] ************************************ >2018-08-30 12:06:40,705 p=7972 u=mistral | Thursday 30 August 2018 12:06:40 -0400 (0:00:01.134) 0:04:26.885 ******* >2018-08-30 12:06:40,736 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.28) >2018-08-30 12:06:40,746 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.36) >2018-08-30 12:06:40,749 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.32) >2018-08-30 12:06:40,769 p=7972 u=mistral | TASK [ceph-mon : create configured crush rules] ******************************** >2018-08-30 12:06:40,769 p=7972 u=mistral | Thursday 30 August 2018 12:06:40 -0400 (0:00:00.064) 0:04:26.949 ******* >2018-08-30 12:06:40,807 p=7972 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:06:40,810 p=7972 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:06:40,824 p=7972 u=mistral | TASK [ceph-mon : get id for new default crush rule] **************************** >2018-08-30 12:06:40,825 p=7972 u=mistral | Thursday 30 August 2018 12:06:40 -0400 (0:00:00.055) 0:04:27.005 ******* >2018-08-30 12:06:40,862 p=7972 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:06:40,868 p=7972 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:06:40,883 p=7972 u=mistral | TASK [ceph-mon : set_fact info_ceph_default_crush_rule_yaml] ******************* >2018-08-30 12:06:40,884 p=7972 u=mistral | Thursday 30 August 2018 12:06:40 -0400 (0:00:00.058) 0:04:27.064 ******* >2018-08-30 12:06:40,920 p=7972 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'HDD', u'name': u'HDD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:06:40,926 p=7972 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'SSD', u'name': u'SSD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:06:40,945 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_crush_rule to osd_pool_default_crush_replicated_ruleset if release < luminous else osd_pool_default_crush_rule] *** >2018-08-30 12:06:40,946 p=7972 u=mistral | Thursday 30 August 2018 12:06:40 -0400 (0:00:00.062) 0:04:27.126 ******* >2018-08-30 12:06:40,972 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:41,047 p=7972 u=mistral | TASK [ceph-mon : insert new default crush rule into daemon to prevent restart] *** >2018-08-30 12:06:41,047 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.101) 0:04:27.227 ******* >2018-08-30 12:06:41,083 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:06:41,088 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:06:41,093 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:06:41,151 p=7972 u=mistral | TASK [ceph-mon : add new default crush rule to ceph.conf] ********************** >2018-08-30 12:06:41,152 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.104) 0:04:27.332 ******* >2018-08-30 12:06:41,182 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:06:41,192 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:06:41,197 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:06:41,213 p=7972 u=mistral | TASK [ceph-mon : get default value for osd_pool_default_pg_num] **************** >2018-08-30 12:06:41,214 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.061) 0:04:27.394 ******* >2018-08-30 12:06:41,257 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:41,273 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with pool_default_pg_num (backward compatibility)] *** >2018-08-30 12:06:41,273 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.059) 0:04:27.453 ******* >2018-08-30 12:06:41,306 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:41,322 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with default_pool_default_pg_num.stdout] *** >2018-08-30 12:06:41,322 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.049) 0:04:27.503 ******* >2018-08-30 12:06:41,351 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:41,367 p=7972 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num ceph_conf_overrides.global.osd_pool_default_pg_num] *** >2018-08-30 12:06:41,367 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.044) 0:04:27.547 ******* >2018-08-30 12:06:41,427 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:41,441 p=7972 u=mistral | TASK [ceph-mon : increase calamari logging level when debug is on] ************* >2018-08-30 12:06:41,442 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.074) 0:04:27.622 ******* >2018-08-30 12:06:41,470 p=7972 u=mistral | skipping: [172.16.0.25] => (item=cthulhu) >2018-08-30 12:06:41,475 p=7972 u=mistral | skipping: [172.16.0.25] => (item=calamari_web) >2018-08-30 12:06:41,492 p=7972 u=mistral | TASK [ceph-mon : initialize the calamari server api] *************************** >2018-08-30 12:06:41,493 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.050) 0:04:27.673 ******* >2018-08-30 12:06:41,523 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:06:41,524 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:06:41,524 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.031) 0:04:27.704 ******* >2018-08-30 12:06:41,598 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:41,599 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:06:41,600 p=7972 u=mistral | Thursday 30 August 2018 12:06:41 -0400 (0:00:00.075) 0:04:27.780 ******* >2018-08-30 12:06:42,497 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:06:42,498 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:06:42,499 p=7972 u=mistral | Thursday 30 August 2018 12:06:42 -0400 (0:00:00.898) 0:04:28.679 ******* >2018-08-30 12:06:42,590 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:06:42,602 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:06:42,615 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:06:42,619 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:06:42,620 p=7972 u=mistral | Thursday 30 August 2018 12:06:42 -0400 (0:00:00.121) 0:04:28.800 ******* >2018-08-30 12:06:42,774 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:06:42,817 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:06:42,861 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:06:42,863 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:06:42,864 p=7972 u=mistral | Thursday 30 August 2018 12:06:42 -0400 (0:00:00.244) 0:04:29.044 ******* >2018-08-30 12:06:42,948 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:06:42,976 p=7972 u=mistral | TASK [non container | waiting for the monitor to join the quorum...] *********** >2018-08-30 12:06:42,976 p=7972 u=mistral | Thursday 30 August 2018 12:06:42 -0400 (0:00:00.112) 0:04:29.156 ******* >2018-08-30 12:06:43,817 p=7972 u=mistral | changed: [172.16.0.25 -> 172.16.0.24] >2018-08-30 12:06:43,836 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph mgr] ************** >2018-08-30 12:06:43,924 p=7972 u=mistral | TASK [stop non-containerized ceph mgr(s)] ************************************** >2018-08-30 12:06:43,924 p=7972 u=mistral | Thursday 30 August 2018 12:06:43 -0400 (0:00:00.947) 0:04:30.104 ******* >2018-08-30 12:06:44,306 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:44,322 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:06:44,323 p=7972 u=mistral | Thursday 30 August 2018 12:06:44 -0400 (0:00:00.398) 0:04:30.503 ******* >2018-08-30 12:06:44,356 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:44,371 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:06:44,371 p=7972 u=mistral | Thursday 30 August 2018 12:06:44 -0400 (0:00:00.048) 0:04:30.551 ******* >2018-08-30 12:06:44,443 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:44,458 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:06:44,458 p=7972 u=mistral | Thursday 30 August 2018 12:06:44 -0400 (0:00:00.086) 0:04:30.638 ******* >2018-08-30 12:06:44,848 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph) >2018-08-30 12:06:45,162 p=7972 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:06:45,183 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:06:45,184 p=7972 u=mistral | Thursday 30 August 2018 12:06:45 -0400 (0:00:00.725) 0:04:31.364 ******* >2018-08-30 12:06:45,579 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:45,596 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:06:45,596 p=7972 u=mistral | Thursday 30 August 2018 12:06:45 -0400 (0:00:00.412) 0:04:31.777 ******* >2018-08-30 12:06:45,626 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:45,641 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:06:45,641 p=7972 u=mistral | Thursday 30 August 2018 12:06:45 -0400 (0:00:00.044) 0:04:31.822 ******* >2018-08-30 12:06:45,672 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:45,687 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:06:45,687 p=7972 u=mistral | Thursday 30 August 2018 12:06:45 -0400 (0:00:00.045) 0:04:31.867 ******* >2018-08-30 12:06:45,720 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:45,735 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:06:45,735 p=7972 u=mistral | Thursday 30 August 2018 12:06:45 -0400 (0:00:00.047) 0:04:31.915 ******* >2018-08-30 12:06:46,114 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:46,129 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:06:46,130 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.394) 0:04:32.310 ******* >2018-08-30 12:06:46,159 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,174 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:06:46,174 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.044) 0:04:32.354 ******* >2018-08-30 12:06:46,211 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,229 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:06:46,230 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.055) 0:04:32.410 ******* >2018-08-30 12:06:46,260 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,276 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:06:46,277 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.047) 0:04:32.457 ******* >2018-08-30 12:06:46,314 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,330 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:06:46,330 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.053) 0:04:32.510 ******* >2018-08-30 12:06:46,361 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,376 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:06:46,377 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.046) 0:04:32.557 ******* >2018-08-30 12:06:46,406 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,424 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:06:46,424 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.047) 0:04:32.604 ******* >2018-08-30 12:06:46,454 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,469 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:06:46,469 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.044) 0:04:32.649 ******* >2018-08-30 12:06:46,501 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,518 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:06:46,518 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.048) 0:04:32.698 ******* >2018-08-30 12:06:46,552 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,567 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:06:46,567 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.049) 0:04:32.747 ******* >2018-08-30 12:06:46,600 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,614 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:06:46,615 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.047) 0:04:32.795 ******* >2018-08-30 12:06:46,643 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,657 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:06:46,657 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.042) 0:04:32.838 ******* >2018-08-30 12:06:46,685 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,703 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:06:46,704 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.046) 0:04:32.884 ******* >2018-08-30 12:06:46,734 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,749 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:06:46,750 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.045) 0:04:32.930 ******* >2018-08-30 12:06:46,785 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,801 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:06:46,802 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.051) 0:04:32.982 ******* >2018-08-30 12:06:46,830 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,845 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:06:46,845 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.043) 0:04:33.025 ******* >2018-08-30 12:06:46,873 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,891 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:06:46,892 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.046) 0:04:33.072 ******* >2018-08-30 12:06:46,921 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,936 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:06:46,936 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.044) 0:04:33.117 ******* >2018-08-30 12:06:46,964 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:46,979 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:06:46,980 p=7972 u=mistral | Thursday 30 August 2018 12:06:46 -0400 (0:00:00.043) 0:04:33.160 ******* >2018-08-30 12:06:47,012 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:47,029 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:06:47,030 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.049) 0:04:33.210 ******* >2018-08-30 12:06:47,061 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:47,077 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:06:47,078 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.047) 0:04:33.258 ******* >2018-08-30 12:06:47,105 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:47,122 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:06:47,123 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.044) 0:04:33.303 ******* >2018-08-30 12:06:47,149 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:47,165 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:06:47,165 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.042) 0:04:33.345 ******* >2018-08-30 12:06:47,194 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:47,210 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:06:47,210 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.044) 0:04:33.390 ******* >2018-08-30 12:06:47,539 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:47,557 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:06:47,557 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.346) 0:04:33.737 ******* >2018-08-30 12:06:47,617 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:47,631 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:06:47,631 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.073) 0:04:33.811 ******* >2018-08-30 12:06:47,700 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:47,714 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:06:47,714 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.083) 0:04:33.894 ******* >2018-08-30 12:06:47,742 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:47,771 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:06:47,772 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.057) 0:04:33.952 ******* >2018-08-30 12:06:47,868 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:06:47,900 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:06:47,901 p=7972 u=mistral | Thursday 30 August 2018 12:06:47 -0400 (0:00:00.128) 0:04:34.081 ******* >2018-08-30 12:06:48,742 p=7972 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:06:48,775 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:06:48,775 p=7972 u=mistral | Thursday 30 August 2018 12:06:48 -0400 (0:00:00.874) 0:04:34.956 ******* >2018-08-30 12:06:49,021 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:06:49,035 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:06:49,035 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.259) 0:04:35.216 ******* >2018-08-30 12:06:49,063 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:49,083 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:06:49,084 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.048) 0:04:35.264 ******* >2018-08-30 12:06:49,318 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:06:49,335 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:06:49,335 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.251) 0:04:35.516 ******* >2018-08-30 12:06:49,393 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:49,413 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:06:49,413 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.077) 0:04:35.594 ******* >2018-08-30 12:06:49,471 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:49,494 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:06:49,494 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.080) 0:04:35.674 ******* >2018-08-30 12:06:49,516 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:49,535 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:06:49,535 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.041) 0:04:35.715 ******* >2018-08-30 12:06:49,781 p=7972 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:06:49,799 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:06:49,799 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.264) 0:04:35.980 ******* >2018-08-30 12:06:49,824 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:49,839 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:06:49,839 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.039) 0:04:36.019 ******* >2018-08-30 12:06:49,865 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:49,880 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:06:49,880 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.040) 0:04:36.060 ******* >2018-08-30 12:06:49,945 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:49,961 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:06:49,961 p=7972 u=mistral | Thursday 30 August 2018 12:06:49 -0400 (0:00:00.080) 0:04:36.141 ******* >2018-08-30 12:06:49,989 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,004 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:06:50,005 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.043) 0:04:36.185 ******* >2018-08-30 12:06:50,037 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,052 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:06:50,052 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.047) 0:04:36.232 ******* >2018-08-30 12:06:50,084 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,099 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:06:50,099 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.047) 0:04:36.280 ******* >2018-08-30 12:06:50,126 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,141 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:06:50,141 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.041) 0:04:36.321 ******* >2018-08-30 12:06:50,179 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/dev/vdb) >2018-08-30 12:06:50,195 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:06:50,195 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.054) 0:04:36.375 ******* >2018-08-30 12:06:50,240 p=7972 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:06:50,256 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:06:50,256 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.061) 0:04:36.436 ******* >2018-08-30 12:06:50,286 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,302 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:06:50,303 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.046) 0:04:36.483 ******* >2018-08-30 12:06:50,333 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,348 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:06:50,348 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.045) 0:04:36.529 ******* >2018-08-30 12:06:50,380 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,397 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:06:50,397 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.048) 0:04:36.577 ******* >2018-08-30 12:06:50,427 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,443 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:06:50,443 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.045) 0:04:36.623 ******* >2018-08-30 12:06:50,479 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:50,496 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:06:50,496 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.053) 0:04:36.677 ******* >2018-08-30 12:06:50,558 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:50,572 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:06:50,573 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.076) 0:04:36.753 ******* >2018-08-30 12:06:50,628 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:50,642 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:06:50,643 p=7972 u=mistral | Thursday 30 August 2018 12:06:50 -0400 (0:00:00.069) 0:04:36.823 ******* >2018-08-30 12:06:50,980 p=7972 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:06:51,276 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/) >2018-08-30 12:06:51,713 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mon) >2018-08-30 12:06:52,019 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/osd) >2018-08-30 12:06:52,320 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mds) >2018-08-30 12:06:52,635 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/tmp) >2018-08-30 12:06:52,951 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:06:53,285 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:06:53,594 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:06:53,902 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:06:54,193 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:06:54,473 p=7972 u=mistral | ok: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:06:54,501 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:06:54,501 p=7972 u=mistral | Thursday 30 August 2018 12:06:54 -0400 (0:00:03.858) 0:04:40.681 ******* >2018-08-30 12:06:54,529 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:54,544 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:06:54,544 p=7972 u=mistral | Thursday 30 August 2018 12:06:54 -0400 (0:00:00.043) 0:04:40.725 ******* >2018-08-30 12:06:54,584 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:54,599 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:06:54,599 p=7972 u=mistral | Thursday 30 August 2018 12:06:54 -0400 (0:00:00.054) 0:04:40.779 ******* >2018-08-30 12:06:54,629 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:54,645 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:06:54,645 p=7972 u=mistral | Thursday 30 August 2018 12:06:54 -0400 (0:00:00.046) 0:04:40.825 ******* >2018-08-30 12:06:54,980 p=7972 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:06:55,264 p=7972 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:06:55,280 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:06:55,281 p=7972 u=mistral | Thursday 30 August 2018 12:06:55 -0400 (0:00:00.635) 0:04:41.461 ******* >2018-08-30 12:06:55,341 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:55,355 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:06:55,355 p=7972 u=mistral | Thursday 30 August 2018 12:06:55 -0400 (0:00:00.074) 0:04:41.535 ******* >2018-08-30 12:06:55,378 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:55,393 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:06:55,394 p=7972 u=mistral | Thursday 30 August 2018 12:06:55 -0400 (0:00:00.038) 0:04:41.574 ******* >2018-08-30 12:06:55,759 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:55,773 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:06:55,773 p=7972 u=mistral | Thursday 30 August 2018 12:06:55 -0400 (0:00:00.379) 0:04:41.953 ******* >2018-08-30 12:06:55,837 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:55,851 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:06:55,851 p=7972 u=mistral | Thursday 30 August 2018 12:06:55 -0400 (0:00:00.077) 0:04:42.031 ******* >2018-08-30 12:06:56,235 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:56,250 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:06:56,250 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.399) 0:04:42.430 ******* >2018-08-30 12:06:56,293 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:56,308 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:06:56,309 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.058) 0:04:42.489 ******* >2018-08-30 12:06:56,368 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:06:56,393 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:06:56,413 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:06:56,429 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:06:56,430 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.120) 0:04:42.610 ******* >2018-08-30 12:06:56,472 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:56,488 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:06:56,489 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.059) 0:04:42.669 ******* >2018-08-30 12:06:56,528 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:56,550 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:06:56,551 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.062) 0:04:42.731 ******* >2018-08-30 12:06:56,602 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:06:56,623 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:06:56,643 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:06:56,659 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:06:56,676 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:06:56,696 p=7972 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:06:56,711 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:06:56,711 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.159) 0:04:42.891 ******* >2018-08-30 12:06:56,762 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:06:56,778 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mon.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:06:56,796 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:06:56,811 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:06:56,827 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:06:56,842 p=7972 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:06:56,859 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:06:56,859 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.148) 0:04:43.039 ******* >2018-08-30 12:06:56,887 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:56,904 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:06:56,904 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.045) 0:04:43.084 ******* >2018-08-30 12:06:56,931 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:56,946 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:06:56,946 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.042) 0:04:43.127 ******* >2018-08-30 12:06:56,978 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:56,993 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:06:56,994 p=7972 u=mistral | Thursday 30 August 2018 12:06:56 -0400 (0:00:00.047) 0:04:43.174 ******* >2018-08-30 12:06:57,027 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,041 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:06:57,042 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.047) 0:04:43.222 ******* >2018-08-30 12:06:57,077 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,093 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:06:57,093 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.050) 0:04:43.273 ******* >2018-08-30 12:06:57,121 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,139 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:06:57,140 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.046) 0:04:43.320 ******* >2018-08-30 12:06:57,168 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,182 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:06:57,183 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.042) 0:04:43.363 ******* >2018-08-30 12:06:57,212 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,227 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:06:57,228 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.044) 0:04:43.408 ******* >2018-08-30 12:06:57,609 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:57,641 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:06:57,641 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.413) 0:04:43.822 ******* >2018-08-30 12:06:57,670 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,685 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:06:57,685 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.043) 0:04:43.865 ******* >2018-08-30 12:06:57,710 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,725 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:06:57,725 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.040) 0:04:43.905 ******* >2018-08-30 12:06:57,751 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,766 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:06:57,766 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.040) 0:04:43.946 ******* >2018-08-30 12:06:57,800 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,814 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:06:57,814 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.048) 0:04:43.995 ******* >2018-08-30 12:06:57,839 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,854 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:06:57,854 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.039) 0:04:44.034 ******* >2018-08-30 12:06:57,882 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:57,897 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:06:57,897 p=7972 u=mistral | Thursday 30 August 2018 12:06:57 -0400 (0:00:00.042) 0:04:44.077 ******* >2018-08-30 12:06:58,308 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:58,333 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:06:58,334 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.436) 0:04:44.514 ******* >2018-08-30 12:06:58,368 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,385 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:06:58,386 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.051) 0:04:44.566 ******* >2018-08-30 12:06:58,421 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,436 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:06:58,437 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.050) 0:04:44.617 ******* >2018-08-30 12:06:58,466 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,484 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:06:58,485 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.047) 0:04:44.665 ******* >2018-08-30 12:06:58,522 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,545 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:06:58,545 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.060) 0:04:44.725 ******* >2018-08-30 12:06:58,578 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,593 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:06:58,594 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.048) 0:04:44.774 ******* >2018-08-30 12:06:58,629 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,645 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:06:58,645 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.051) 0:04:44.825 ******* >2018-08-30 12:06:58,727 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:58,744 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:06:58,745 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.099) 0:04:44.925 ******* >2018-08-30 12:06:58,775 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,793 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:06:58,793 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.048) 0:04:44.974 ******* >2018-08-30 12:06:58,826 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,841 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:06:58,841 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.047) 0:04:45.021 ******* >2018-08-30 12:06:58,866 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,880 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:06:58,881 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.039) 0:04:45.061 ******* >2018-08-30 12:06:58,914 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,938 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:06:58,939 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.057) 0:04:45.119 ******* >2018-08-30 12:06:58,976 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:58,995 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:06:58,996 p=7972 u=mistral | Thursday 30 August 2018 12:06:58 -0400 (0:00:00.056) 0:04:45.176 ******* >2018-08-30 12:06:59,033 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:06:59,051 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:06:59,051 p=7972 u=mistral | Thursday 30 August 2018 12:06:59 -0400 (0:00:00.055) 0:04:45.231 ******* >2018-08-30 12:06:59,480 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:06:59,505 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:06:59,505 p=7972 u=mistral | Thursday 30 August 2018 12:06:59 -0400 (0:00:00.453) 0:04:45.685 ******* >2018-08-30 12:06:59,915 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:06:59,938 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:06:59,939 p=7972 u=mistral | Thursday 30 August 2018 12:06:59 -0400 (0:00:00.433) 0:04:46.119 ******* >2018-08-30 12:07:00,014 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:00,029 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:07:00,030 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.091) 0:04:46.210 ******* >2018-08-30 12:07:00,072 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,086 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:07:00,086 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.056) 0:04:46.267 ******* >2018-08-30 12:07:00,115 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,137 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:07:00,137 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.050) 0:04:46.318 ******* >2018-08-30 12:07:00,174 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,201 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:07:00,201 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.063) 0:04:46.381 ******* >2018-08-30 12:07:00,234 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,261 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:07:00,261 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.060) 0:04:46.441 ******* >2018-08-30 12:07:00,302 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,316 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:07:00,316 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.054) 0:04:46.496 ******* >2018-08-30 12:07:00,347 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,370 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:07:00,370 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.054) 0:04:46.550 ******* >2018-08-30 12:07:00,405 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,434 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:07:00,435 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.064) 0:04:46.615 ******* >2018-08-30 12:07:00,466 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,482 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:07:00,482 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.047) 0:04:46.662 ******* >2018-08-30 12:07:00,519 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,535 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:07:00,536 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.053) 0:04:46.716 ******* >2018-08-30 12:07:00,568 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,583 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:07:00,583 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.047) 0:04:46.764 ******* >2018-08-30 12:07:00,614 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:00,629 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:07:00,629 p=7972 u=mistral | Thursday 30 August 2018 12:07:00 -0400 (0:00:00.045) 0:04:46.810 ******* >2018-08-30 12:07:01,572 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:01,587 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:07:01,587 p=7972 u=mistral | Thursday 30 August 2018 12:07:01 -0400 (0:00:00.957) 0:04:47.767 ******* >2018-08-30 12:07:01,639 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:01,654 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:07:01,654 p=7972 u=mistral | Thursday 30 August 2018 12:07:01 -0400 (0:00:00.067) 0:04:47.835 ******* >2018-08-30 12:07:01,681 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:01,697 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:07:01,697 p=7972 u=mistral | Thursday 30 August 2018 12:07:01 -0400 (0:00:00.042) 0:04:47.877 ******* >2018-08-30 12:07:01,729 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:01,743 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:07:01,743 p=7972 u=mistral | Thursday 30 August 2018 12:07:01 -0400 (0:00:00.045) 0:04:47.923 ******* >2018-08-30 12:07:01,808 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:01,824 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:07:01,824 p=7972 u=mistral | Thursday 30 August 2018 12:07:01 -0400 (0:00:00.081) 0:04:48.005 ******* >2018-08-30 12:07:01,856 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:01,874 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:07:01,874 p=7972 u=mistral | Thursday 30 August 2018 12:07:01 -0400 (0:00:00.049) 0:04:48.054 ******* >2018-08-30 12:07:01,906 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:01,924 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:07:01,924 p=7972 u=mistral | Thursday 30 August 2018 12:07:01 -0400 (0:00:00.049) 0:04:48.104 ******* >2018-08-30 12:07:02,257 p=7972 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:07:02,697 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:07:03,007 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:07:03,303 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:07:03,602 p=7972 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:07:03,620 p=7972 u=mistral | TASK [ceph-mgr : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:07:03,620 p=7972 u=mistral | Thursday 30 August 2018 12:07:03 -0400 (0:00:01.695) 0:04:49.800 ******* >2018-08-30 12:07:03,713 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:03,731 p=7972 u=mistral | TASK [ceph-mgr : create mgr directory] ***************************************** >2018-08-30 12:07:03,732 p=7972 u=mistral | Thursday 30 August 2018 12:07:03 -0400 (0:00:00.111) 0:04:49.912 ******* >2018-08-30 12:07:04,070 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:04,085 p=7972 u=mistral | TASK [ceph-mgr : copy ceph keyring(s) if needed] ******************************* >2018-08-30 12:07:04,085 p=7972 u=mistral | Thursday 30 August 2018 12:07:04 -0400 (0:00:00.353) 0:04:50.265 ******* >2018-08-30 12:07:04,867 p=7972 u=mistral | changed: [172.16.0.33] => (item={u'dest': u'/var/lib/ceph/mgr/ceph-lab-controller03/keyring', u'name': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'copy_key': True}) >2018-08-30 12:07:04,877 p=7972 u=mistral | skipping: [172.16.0.33] => (item={u'dest': u'/etc/ceph/ceph.client.admin.keyring', u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:07:04,894 p=7972 u=mistral | TASK [ceph-mgr : set mgr key permissions] ************************************** >2018-08-30 12:07:04,894 p=7972 u=mistral | Thursday 30 August 2018 12:07:04 -0400 (0:00:00.808) 0:04:51.074 ******* >2018-08-30 12:07:05,240 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:05,255 p=7972 u=mistral | TASK [ceph-mgr : install ceph-mgr package on RedHat or SUSE] ******************* >2018-08-30 12:07:05,255 p=7972 u=mistral | Thursday 30 August 2018 12:07:05 -0400 (0:00:00.360) 0:04:51.435 ******* >2018-08-30 12:07:05,283 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:05,297 p=7972 u=mistral | TASK [ceph-mgr : install ceph mgr for debian] ********************************** >2018-08-30 12:07:05,297 p=7972 u=mistral | Thursday 30 August 2018 12:07:05 -0400 (0:00:00.042) 0:04:51.477 ******* >2018-08-30 12:07:05,326 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:05,340 p=7972 u=mistral | TASK [ceph-mgr : ensure systemd service override directory exists] ************* >2018-08-30 12:07:05,340 p=7972 u=mistral | Thursday 30 August 2018 12:07:05 -0400 (0:00:00.042) 0:04:51.520 ******* >2018-08-30 12:07:05,367 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:05,382 p=7972 u=mistral | TASK [ceph-mgr : add ceph-mgr systemd service overrides] *********************** >2018-08-30 12:07:05,382 p=7972 u=mistral | Thursday 30 August 2018 12:07:05 -0400 (0:00:00.041) 0:04:51.562 ******* >2018-08-30 12:07:05,412 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:05,427 p=7972 u=mistral | TASK [ceph-mgr : start and add that the mgr service to the init sequence] ****** >2018-08-30 12:07:05,427 p=7972 u=mistral | Thursday 30 August 2018 12:07:05 -0400 (0:00:00.044) 0:04:51.607 ******* >2018-08-30 12:07:05,456 p=7972 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:07:05,471 p=7972 u=mistral | TASK [ceph-mgr : generate systemd unit file] *********************************** >2018-08-30 12:07:05,471 p=7972 u=mistral | Thursday 30 August 2018 12:07:05 -0400 (0:00:00.044) 0:04:51.652 ******* >2018-08-30 12:07:06,583 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:07:06,594 p=7972 u=mistral | TASK [ceph-mgr : systemd start mgr container] ********************************** >2018-08-30 12:07:06,595 p=7972 u=mistral | Thursday 30 August 2018 12:07:06 -0400 (0:00:01.123) 0:04:52.775 ******* >2018-08-30 12:07:07,525 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:07:07,555 p=7972 u=mistral | TASK [ceph-mgr : get enabled modules from ceph-mgr] **************************** >2018-08-30 12:07:07,555 p=7972 u=mistral | Thursday 30 August 2018 12:07:07 -0400 (0:00:00.960) 0:04:53.735 ******* >2018-08-30 12:07:08,460 p=7972 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:07:08,477 p=7972 u=mistral | TASK [ceph-mgr : set _ceph_mgr_modules fact] *********************************** >2018-08-30 12:07:08,477 p=7972 u=mistral | Thursday 30 August 2018 12:07:08 -0400 (0:00:00.921) 0:04:54.657 ******* >2018-08-30 12:07:08,536 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:08,566 p=7972 u=mistral | TASK [ceph-mgr : disable ceph mgr enabled modules] ***************************** >2018-08-30 12:07:08,566 p=7972 u=mistral | Thursday 30 August 2018 12:07:08 -0400 (0:00:00.089) 0:04:54.747 ******* >2018-08-30 12:07:10,233 p=7972 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] => (item=balancer) >2018-08-30 12:07:11,250 p=7972 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] => (item=restful) >2018-08-30 12:07:11,260 p=7972 u=mistral | skipping: [172.16.0.33] => (item=status) >2018-08-30 12:07:11,291 p=7972 u=mistral | TASK [ceph-mgr : add modules to ceph-mgr] ************************************** >2018-08-30 12:07:11,291 p=7972 u=mistral | Thursday 30 August 2018 12:07:11 -0400 (0:00:02.724) 0:04:57.471 ******* >2018-08-30 12:07:11,328 p=7972 u=mistral | skipping: [172.16.0.33] => (item=status) >2018-08-30 12:07:11,330 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:07:11,330 p=7972 u=mistral | Thursday 30 August 2018 12:07:11 -0400 (0:00:00.039) 0:04:57.510 ******* >2018-08-30 12:07:11,404 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:11,405 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:07:11,405 p=7972 u=mistral | Thursday 30 August 2018 12:07:11 -0400 (0:00:00.074) 0:04:57.585 ******* >2018-08-30 12:07:12,209 p=7972 u=mistral | changed: [172.16.0.33] >2018-08-30 12:07:12,210 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:07:12,211 p=7972 u=mistral | Thursday 30 August 2018 12:07:12 -0400 (0:00:00.805) 0:04:58.391 ******* >2018-08-30 12:07:12,302 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:07:12,309 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:07:12,319 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:07:12,321 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:07:12,321 p=7972 u=mistral | Thursday 30 August 2018 12:07:12 -0400 (0:00:00.110) 0:04:58.501 ******* >2018-08-30 12:07:12,447 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:07:12,488 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:07:12,528 p=7972 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:07:12,531 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:07:12,532 p=7972 u=mistral | Thursday 30 August 2018 12:07:12 -0400 (0:00:00.210) 0:04:58.712 ******* >2018-08-30 12:07:12,608 p=7972 u=mistral | ok: [172.16.0.33] >2018-08-30 12:07:12,623 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph mgr] ************** >2018-08-30 12:07:12,714 p=7972 u=mistral | TASK [stop non-containerized ceph mgr(s)] ************************************** >2018-08-30 12:07:12,714 p=7972 u=mistral | Thursday 30 August 2018 12:07:12 -0400 (0:00:00.182) 0:04:58.894 ******* >2018-08-30 12:07:13,259 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:13,274 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:07:13,274 p=7972 u=mistral | Thursday 30 August 2018 12:07:13 -0400 (0:00:00.559) 0:04:59.454 ******* >2018-08-30 12:07:13,305 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:13,322 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:07:13,322 p=7972 u=mistral | Thursday 30 August 2018 12:07:13 -0400 (0:00:00.048) 0:04:59.502 ******* >2018-08-30 12:07:13,395 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:13,408 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:07:13,408 p=7972 u=mistral | Thursday 30 August 2018 12:07:13 -0400 (0:00:00.085) 0:04:59.588 ******* >2018-08-30 12:07:13,784 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph) >2018-08-30 12:07:14,244 p=7972 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:07:14,262 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:07:14,262 p=7972 u=mistral | Thursday 30 August 2018 12:07:14 -0400 (0:00:00.853) 0:05:00.442 ******* >2018-08-30 12:07:14,669 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:14,684 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:07:14,684 p=7972 u=mistral | Thursday 30 August 2018 12:07:14 -0400 (0:00:00.422) 0:05:00.864 ******* >2018-08-30 12:07:14,716 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:14,732 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:07:14,732 p=7972 u=mistral | Thursday 30 August 2018 12:07:14 -0400 (0:00:00.047) 0:05:00.912 ******* >2018-08-30 12:07:14,763 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:14,778 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:07:14,778 p=7972 u=mistral | Thursday 30 August 2018 12:07:14 -0400 (0:00:00.045) 0:05:00.958 ******* >2018-08-30 12:07:14,805 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:14,819 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:07:14,819 p=7972 u=mistral | Thursday 30 August 2018 12:07:14 -0400 (0:00:00.041) 0:05:00.999 ******* >2018-08-30 12:07:15,325 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:15,340 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:07:15,340 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.520) 0:05:01.520 ******* >2018-08-30 12:07:15,370 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,383 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:07:15,383 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.043) 0:05:01.564 ******* >2018-08-30 12:07:15,417 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,432 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:07:15,432 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.048) 0:05:01.612 ******* >2018-08-30 12:07:15,461 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,480 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:07:15,480 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.047) 0:05:01.660 ******* >2018-08-30 12:07:15,511 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,529 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:07:15,530 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.049) 0:05:01.710 ******* >2018-08-30 12:07:15,563 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,581 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:07:15,581 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.051) 0:05:01.761 ******* >2018-08-30 12:07:15,608 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,622 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:07:15,622 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.041) 0:05:01.803 ******* >2018-08-30 12:07:15,652 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,668 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:07:15,669 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.046) 0:05:01.849 ******* >2018-08-30 12:07:15,700 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,715 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:07:15,715 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.046) 0:05:01.895 ******* >2018-08-30 12:07:15,744 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,758 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:07:15,759 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.043) 0:05:01.939 ******* >2018-08-30 12:07:15,789 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,804 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:07:15,804 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.045) 0:05:01.984 ******* >2018-08-30 12:07:15,832 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,849 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:07:15,850 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.045) 0:05:02.030 ******* >2018-08-30 12:07:15,880 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,895 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:07:15,896 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.046) 0:05:02.076 ******* >2018-08-30 12:07:15,926 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,942 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:07:15,942 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.046) 0:05:02.122 ******* >2018-08-30 12:07:15,974 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:15,988 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:07:15,988 p=7972 u=mistral | Thursday 30 August 2018 12:07:15 -0400 (0:00:00.046) 0:05:02.168 ******* >2018-08-30 12:07:16,016 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,032 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:07:16,032 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.044) 0:05:02.212 ******* >2018-08-30 12:07:16,065 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,079 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:07:16,079 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.046) 0:05:02.259 ******* >2018-08-30 12:07:16,110 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,129 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:07:16,129 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.050) 0:05:02.309 ******* >2018-08-30 12:07:16,161 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,176 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:07:16,176 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.046) 0:05:02.356 ******* >2018-08-30 12:07:16,204 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,218 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:07:16,219 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.042) 0:05:02.399 ******* >2018-08-30 12:07:16,248 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,263 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:07:16,263 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.044) 0:05:02.443 ******* >2018-08-30 12:07:16,293 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,307 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:07:16,307 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.044) 0:05:02.487 ******* >2018-08-30 12:07:16,339 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,355 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:07:16,355 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.048) 0:05:02.535 ******* >2018-08-30 12:07:16,386 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:16,401 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:07:16,401 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.045) 0:05:02.581 ******* >2018-08-30 12:07:16,725 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:16,743 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:07:16,743 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.342) 0:05:02.924 ******* >2018-08-30 12:07:16,973 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:16,986 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:07:16,987 p=7972 u=mistral | Thursday 30 August 2018 12:07:16 -0400 (0:00:00.243) 0:05:03.167 ******* >2018-08-30 12:07:17,225 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:17,241 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:07:17,241 p=7972 u=mistral | Thursday 30 August 2018 12:07:17 -0400 (0:00:00.254) 0:05:03.421 ******* >2018-08-30 12:07:17,263 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:17,302 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:07:17,302 p=7972 u=mistral | Thursday 30 August 2018 12:07:17 -0400 (0:00:00.061) 0:05:03.483 ******* >2018-08-30 12:07:17,576 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:07:17,604 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:07:17,605 p=7972 u=mistral | Thursday 30 August 2018 12:07:17 -0400 (0:00:00.302) 0:05:03.785 ******* >2018-08-30 12:07:18,599 p=7972 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:07:18,617 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:07:18,618 p=7972 u=mistral | Thursday 30 August 2018 12:07:18 -0400 (0:00:01.012) 0:05:04.798 ******* >2018-08-30 12:07:18,831 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:07:18,845 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:07:18,845 p=7972 u=mistral | Thursday 30 August 2018 12:07:18 -0400 (0:00:00.227) 0:05:05.025 ******* >2018-08-30 12:07:18,873 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:18,890 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:07:18,890 p=7972 u=mistral | Thursday 30 August 2018 12:07:18 -0400 (0:00:00.044) 0:05:05.070 ******* >2018-08-30 12:07:19,125 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:07:19,139 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:07:19,139 p=7972 u=mistral | Thursday 30 August 2018 12:07:19 -0400 (0:00:00.249) 0:05:05.320 ******* >2018-08-30 12:07:19,375 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:19,392 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:07:19,393 p=7972 u=mistral | Thursday 30 August 2018 12:07:19 -0400 (0:00:00.252) 0:05:05.573 ******* >2018-08-30 12:07:19,620 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:19,639 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:07:19,639 p=7972 u=mistral | Thursday 30 August 2018 12:07:19 -0400 (0:00:00.246) 0:05:05.820 ******* >2018-08-30 12:07:19,667 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:19,684 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:07:19,685 p=7972 u=mistral | Thursday 30 August 2018 12:07:19 -0400 (0:00:00.045) 0:05:05.865 ******* >2018-08-30 12:07:19,906 p=7972 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:07:19,923 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:07:19,923 p=7972 u=mistral | Thursday 30 August 2018 12:07:19 -0400 (0:00:00.238) 0:05:06.104 ******* >2018-08-30 12:07:19,946 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:19,960 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:07:19,960 p=7972 u=mistral | Thursday 30 August 2018 12:07:19 -0400 (0:00:00.036) 0:05:06.140 ******* >2018-08-30 12:07:19,982 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:19,996 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:07:19,996 p=7972 u=mistral | Thursday 30 August 2018 12:07:19 -0400 (0:00:00.036) 0:05:06.176 ******* >2018-08-30 12:07:20,218 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:20,238 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:07:20,238 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.241) 0:05:06.418 ******* >2018-08-30 12:07:20,262 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,286 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:07:20,286 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.047) 0:05:06.466 ******* >2018-08-30 12:07:20,316 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,330 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:07:20,330 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.043) 0:05:06.510 ******* >2018-08-30 12:07:20,355 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,371 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:07:20,371 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.040) 0:05:06.551 ******* >2018-08-30 12:07:20,399 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,414 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:07:20,415 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.043) 0:05:06.595 ******* >2018-08-30 12:07:20,454 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/dev/vdb) >2018-08-30 12:07:20,469 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:07:20,470 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.054) 0:05:06.650 ******* >2018-08-30 12:07:20,513 p=7972 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:07:20,527 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:07:20,528 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.057) 0:05:06.708 ******* >2018-08-30 12:07:20,557 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,572 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:07:20,572 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.044) 0:05:06.752 ******* >2018-08-30 12:07:20,604 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,622 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:07:20,623 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.050) 0:05:06.803 ******* >2018-08-30 12:07:20,653 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,667 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:07:20,667 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.044) 0:05:06.847 ******* >2018-08-30 12:07:20,697 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,711 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:07:20,712 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.044) 0:05:06.892 ******* >2018-08-30 12:07:20,750 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:20,764 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:07:20,765 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.052) 0:05:06.945 ******* >2018-08-30 12:07:20,830 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:20,846 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:07:20,846 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.081) 0:05:07.026 ******* >2018-08-30 12:07:20,906 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:20,922 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:07:20,922 p=7972 u=mistral | Thursday 30 August 2018 12:07:20 -0400 (0:00:00.076) 0:05:07.102 ******* >2018-08-30 12:07:21,263 p=7972 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:07:21,700 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/) >2018-08-30 12:07:21,983 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mon) >2018-08-30 12:07:22,284 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/osd) >2018-08-30 12:07:22,565 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mds) >2018-08-30 12:07:22,857 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/tmp) >2018-08-30 12:07:23,152 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:07:23,443 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:07:23,725 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:07:24,014 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:07:24,287 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:07:24,584 p=7972 u=mistral | ok: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:07:24,605 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:07:24,605 p=7972 u=mistral | Thursday 30 August 2018 12:07:24 -0400 (0:00:03.683) 0:05:10.785 ******* >2018-08-30 12:07:24,633 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:24,653 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:07:24,653 p=7972 u=mistral | Thursday 30 August 2018 12:07:24 -0400 (0:00:00.047) 0:05:10.833 ******* >2018-08-30 12:07:24,714 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:24,730 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:07:24,731 p=7972 u=mistral | Thursday 30 August 2018 12:07:24 -0400 (0:00:00.077) 0:05:10.911 ******* >2018-08-30 12:07:24,763 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:24,778 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:07:24,779 p=7972 u=mistral | Thursday 30 August 2018 12:07:24 -0400 (0:00:00.047) 0:05:10.959 ******* >2018-08-30 12:07:25,288 p=7972 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:07:25,595 p=7972 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:07:25,610 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:07:25,611 p=7972 u=mistral | Thursday 30 August 2018 12:07:25 -0400 (0:00:00.831) 0:05:11.791 ******* >2018-08-30 12:07:25,678 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:25,694 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:07:25,695 p=7972 u=mistral | Thursday 30 August 2018 12:07:25 -0400 (0:00:00.084) 0:05:11.875 ******* >2018-08-30 12:07:25,725 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:25,739 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:07:25,739 p=7972 u=mistral | Thursday 30 August 2018 12:07:25 -0400 (0:00:00.044) 0:05:11.920 ******* >2018-08-30 12:07:26,087 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:26,108 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:07:26,109 p=7972 u=mistral | Thursday 30 August 2018 12:07:26 -0400 (0:00:00.369) 0:05:12.289 ******* >2018-08-30 12:07:26,171 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:26,192 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:07:26,193 p=7972 u=mistral | Thursday 30 August 2018 12:07:26 -0400 (0:00:00.083) 0:05:12.373 ******* >2018-08-30 12:07:26,546 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:26,561 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:07:26,562 p=7972 u=mistral | Thursday 30 August 2018 12:07:26 -0400 (0:00:00.369) 0:05:12.742 ******* >2018-08-30 12:07:26,599 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:26,614 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:07:26,615 p=7972 u=mistral | Thursday 30 August 2018 12:07:26 -0400 (0:00:00.052) 0:05:12.795 ******* >2018-08-30 12:07:26,666 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:07:26,688 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:07:26,712 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:07:26,728 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:07:26,728 p=7972 u=mistral | Thursday 30 August 2018 12:07:26 -0400 (0:00:00.113) 0:05:12.908 ******* >2018-08-30 12:07:26,776 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:26,794 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:07:26,794 p=7972 u=mistral | Thursday 30 August 2018 12:07:26 -0400 (0:00:00.065) 0:05:12.974 ******* >2018-08-30 12:07:26,839 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:26,861 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:07:26,861 p=7972 u=mistral | Thursday 30 August 2018 12:07:26 -0400 (0:00:00.066) 0:05:13.041 ******* >2018-08-30 12:07:26,916 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:07:26,933 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:07:26,949 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:07:26,964 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:07:26,979 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:07:26,994 p=7972 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:07:27,017 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:07:27,017 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.156) 0:05:13.197 ******* >2018-08-30 12:07:27,070 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:27,085 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mon.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:27,100 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:27,118 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:27,137 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:27,153 p=7972 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:27,170 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:07:27,171 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.153) 0:05:13.351 ******* >2018-08-30 12:07:27,194 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,208 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:07:27,208 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.037) 0:05:13.388 ******* >2018-08-30 12:07:27,234 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,248 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:07:27,248 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.040) 0:05:13.428 ******* >2018-08-30 12:07:27,282 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,299 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:07:27,299 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.050) 0:05:13.479 ******* >2018-08-30 12:07:27,336 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,350 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:07:27,350 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.050) 0:05:13.530 ******* >2018-08-30 12:07:27,384 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,397 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:07:27,397 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.047) 0:05:13.577 ******* >2018-08-30 12:07:27,425 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,441 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:07:27,441 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.043) 0:05:13.621 ******* >2018-08-30 12:07:27,469 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,484 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:07:27,485 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.043) 0:05:13.665 ******* >2018-08-30 12:07:27,513 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:27,532 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:07:27,532 p=7972 u=mistral | Thursday 30 August 2018 12:07:27 -0400 (0:00:00.047) 0:05:13.712 ******* >2018-08-30 12:07:28,108 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:28,132 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:07:28,133 p=7972 u=mistral | Thursday 30 August 2018 12:07:28 -0400 (0:00:00.600) 0:05:14.313 ******* >2018-08-30 12:07:28,169 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:28,190 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:07:28,191 p=7972 u=mistral | Thursday 30 August 2018 12:07:28 -0400 (0:00:00.058) 0:05:14.371 ******* >2018-08-30 12:07:28,223 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:28,247 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:07:28,247 p=7972 u=mistral | Thursday 30 August 2018 12:07:28 -0400 (0:00:00.056) 0:05:14.427 ******* >2018-08-30 12:07:28,281 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:28,304 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:07:28,304 p=7972 u=mistral | Thursday 30 August 2018 12:07:28 -0400 (0:00:00.057) 0:05:14.485 ******* >2018-08-30 12:07:28,341 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:28,356 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:07:28,356 p=7972 u=mistral | Thursday 30 August 2018 12:07:28 -0400 (0:00:00.051) 0:05:14.536 ******* >2018-08-30 12:07:28,384 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:28,399 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:07:28,399 p=7972 u=mistral | Thursday 30 August 2018 12:07:28 -0400 (0:00:00.043) 0:05:14.579 ******* >2018-08-30 12:07:28,429 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:28,443 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:07:28,443 p=7972 u=mistral | Thursday 30 August 2018 12:07:28 -0400 (0:00:00.044) 0:05:14.623 ******* >2018-08-30 12:07:29,035 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:29,056 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:07:29,056 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.612) 0:05:15.236 ******* >2018-08-30 12:07:29,087 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,104 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:07:29,104 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.048) 0:05:15.284 ******* >2018-08-30 12:07:29,133 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,149 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:07:29,149 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.044) 0:05:15.329 ******* >2018-08-30 12:07:29,177 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,195 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:07:29,195 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.046) 0:05:15.375 ******* >2018-08-30 12:07:29,225 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,239 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:07:29,239 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.043) 0:05:15.419 ******* >2018-08-30 12:07:29,269 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,283 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:07:29,283 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.044) 0:05:15.464 ******* >2018-08-30 12:07:29,313 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,327 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:07:29,328 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.044) 0:05:15.508 ******* >2018-08-30 12:07:29,591 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:29,605 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:07:29,606 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.277) 0:05:15.786 ******* >2018-08-30 12:07:29,634 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,649 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:07:29,650 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.044) 0:05:15.830 ******* >2018-08-30 12:07:29,679 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,694 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:07:29,694 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.044) 0:05:15.874 ******* >2018-08-30 12:07:29,723 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,738 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:07:29,738 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.043) 0:05:15.918 ******* >2018-08-30 12:07:29,770 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,783 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:07:29,783 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.045) 0:05:15.963 ******* >2018-08-30 12:07:29,817 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,831 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:07:29,831 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.048) 0:05:16.012 ******* >2018-08-30 12:07:29,859 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:29,888 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:07:29,888 p=7972 u=mistral | Thursday 30 August 2018 12:07:29 -0400 (0:00:00.056) 0:05:16.068 ******* >2018-08-30 12:07:30,450 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:30,468 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:07:30,468 p=7972 u=mistral | Thursday 30 August 2018 12:07:30 -0400 (0:00:00.579) 0:05:16.648 ******* >2018-08-30 12:07:30,841 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:07:30,863 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:07:30,864 p=7972 u=mistral | Thursday 30 August 2018 12:07:30 -0400 (0:00:00.395) 0:05:17.044 ******* >2018-08-30 12:07:31,104 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:31,121 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:07:31,122 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.257) 0:05:17.302 ******* >2018-08-30 12:07:31,158 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,173 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:07:31,173 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.051) 0:05:17.353 ******* >2018-08-30 12:07:31,202 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,216 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:07:31,217 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.043) 0:05:17.397 ******* >2018-08-30 12:07:31,246 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,260 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:07:31,260 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.043) 0:05:17.440 ******* >2018-08-30 12:07:31,286 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,301 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:07:31,301 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.040) 0:05:17.481 ******* >2018-08-30 12:07:31,333 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,349 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:07:31,349 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.048) 0:05:17.529 ******* >2018-08-30 12:07:31,377 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,400 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:07:31,401 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.051) 0:05:17.581 ******* >2018-08-30 12:07:31,430 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,450 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:07:31,450 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.049) 0:05:17.630 ******* >2018-08-30 12:07:31,476 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,492 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:07:31,493 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.042) 0:05:17.673 ******* >2018-08-30 12:07:31,523 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,537 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:07:31,537 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.044) 0:05:17.717 ******* >2018-08-30 12:07:31,569 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,583 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:07:31,584 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.046) 0:05:17.764 ******* >2018-08-30 12:07:31,614 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:31,629 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:07:31,630 p=7972 u=mistral | Thursday 30 August 2018 12:07:31 -0400 (0:00:00.046) 0:05:17.810 ******* >2018-08-30 12:07:32,799 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:32,814 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:07:32,814 p=7972 u=mistral | Thursday 30 August 2018 12:07:32 -0400 (0:00:01.184) 0:05:18.994 ******* >2018-08-30 12:07:32,866 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:32,879 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:07:32,880 p=7972 u=mistral | Thursday 30 August 2018 12:07:32 -0400 (0:00:00.065) 0:05:19.060 ******* >2018-08-30 12:07:32,906 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:32,921 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:07:32,922 p=7972 u=mistral | Thursday 30 August 2018 12:07:32 -0400 (0:00:00.041) 0:05:19.102 ******* >2018-08-30 12:07:32,949 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:32,964 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:07:32,964 p=7972 u=mistral | Thursday 30 August 2018 12:07:32 -0400 (0:00:00.042) 0:05:19.144 ******* >2018-08-30 12:07:33,020 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:33,036 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:07:33,037 p=7972 u=mistral | Thursday 30 August 2018 12:07:33 -0400 (0:00:00.072) 0:05:19.217 ******* >2018-08-30 12:07:33,065 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:33,085 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:07:33,085 p=7972 u=mistral | Thursday 30 August 2018 12:07:33 -0400 (0:00:00.048) 0:05:19.265 ******* >2018-08-30 12:07:33,117 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:33,131 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:07:33,131 p=7972 u=mistral | Thursday 30 August 2018 12:07:33 -0400 (0:00:00.046) 0:05:19.311 ******* >2018-08-30 12:07:33,637 p=7972 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:07:33,938 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:07:34,260 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:07:34,569 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:07:34,852 p=7972 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:07:34,871 p=7972 u=mistral | TASK [ceph-mgr : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:07:34,871 p=7972 u=mistral | Thursday 30 August 2018 12:07:34 -0400 (0:00:01.739) 0:05:21.051 ******* >2018-08-30 12:07:35,120 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:35,143 p=7972 u=mistral | TASK [ceph-mgr : create mgr directory] ***************************************** >2018-08-30 12:07:35,143 p=7972 u=mistral | Thursday 30 August 2018 12:07:35 -0400 (0:00:00.271) 0:05:21.323 ******* >2018-08-30 12:07:35,490 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:35,503 p=7972 u=mistral | TASK [ceph-mgr : copy ceph keyring(s) if needed] ******************************* >2018-08-30 12:07:35,504 p=7972 u=mistral | Thursday 30 August 2018 12:07:35 -0400 (0:00:00.360) 0:05:21.684 ******* >2018-08-30 12:07:36,294 p=7972 u=mistral | changed: [172.16.0.24] => (item={u'dest': u'/var/lib/ceph/mgr/ceph-lab-controller01/keyring', u'name': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'copy_key': True}) >2018-08-30 12:07:36,304 p=7972 u=mistral | skipping: [172.16.0.24] => (item={u'dest': u'/etc/ceph/ceph.client.admin.keyring', u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:07:36,321 p=7972 u=mistral | TASK [ceph-mgr : set mgr key permissions] ************************************** >2018-08-30 12:07:36,322 p=7972 u=mistral | Thursday 30 August 2018 12:07:36 -0400 (0:00:00.817) 0:05:22.502 ******* >2018-08-30 12:07:36,804 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:36,822 p=7972 u=mistral | TASK [ceph-mgr : install ceph-mgr package on RedHat or SUSE] ******************* >2018-08-30 12:07:36,823 p=7972 u=mistral | Thursday 30 August 2018 12:07:36 -0400 (0:00:00.500) 0:05:23.003 ******* >2018-08-30 12:07:36,852 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:36,867 p=7972 u=mistral | TASK [ceph-mgr : install ceph mgr for debian] ********************************** >2018-08-30 12:07:36,867 p=7972 u=mistral | Thursday 30 August 2018 12:07:36 -0400 (0:00:00.044) 0:05:23.047 ******* >2018-08-30 12:07:36,897 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:36,912 p=7972 u=mistral | TASK [ceph-mgr : ensure systemd service override directory exists] ************* >2018-08-30 12:07:36,913 p=7972 u=mistral | Thursday 30 August 2018 12:07:36 -0400 (0:00:00.045) 0:05:23.093 ******* >2018-08-30 12:07:36,940 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:36,957 p=7972 u=mistral | TASK [ceph-mgr : add ceph-mgr systemd service overrides] *********************** >2018-08-30 12:07:36,957 p=7972 u=mistral | Thursday 30 August 2018 12:07:36 -0400 (0:00:00.044) 0:05:23.137 ******* >2018-08-30 12:07:36,986 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:37,001 p=7972 u=mistral | TASK [ceph-mgr : start and add that the mgr service to the init sequence] ****** >2018-08-30 12:07:37,001 p=7972 u=mistral | Thursday 30 August 2018 12:07:37 -0400 (0:00:00.044) 0:05:23.181 ******* >2018-08-30 12:07:37,031 p=7972 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:07:37,048 p=7972 u=mistral | TASK [ceph-mgr : generate systemd unit file] *********************************** >2018-08-30 12:07:37,049 p=7972 u=mistral | Thursday 30 August 2018 12:07:37 -0400 (0:00:00.047) 0:05:23.229 ******* >2018-08-30 12:07:38,323 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:07:38,336 p=7972 u=mistral | TASK [ceph-mgr : systemd start mgr container] ********************************** >2018-08-30 12:07:38,336 p=7972 u=mistral | Thursday 30 August 2018 12:07:38 -0400 (0:00:01.287) 0:05:24.517 ******* >2018-08-30 12:07:39,442 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:07:39,478 p=7972 u=mistral | TASK [ceph-mgr : get enabled modules from ceph-mgr] **************************** >2018-08-30 12:07:39,478 p=7972 u=mistral | Thursday 30 August 2018 12:07:39 -0400 (0:00:01.141) 0:05:25.658 ******* >2018-08-30 12:07:40,456 p=7972 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:07:40,475 p=7972 u=mistral | TASK [ceph-mgr : set _ceph_mgr_modules fact] *********************************** >2018-08-30 12:07:40,475 p=7972 u=mistral | Thursday 30 August 2018 12:07:40 -0400 (0:00:00.996) 0:05:26.655 ******* >2018-08-30 12:07:40,734 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:40,764 p=7972 u=mistral | TASK [ceph-mgr : disable ceph mgr enabled modules] ***************************** >2018-08-30 12:07:40,765 p=7972 u=mistral | Thursday 30 August 2018 12:07:40 -0400 (0:00:00.289) 0:05:26.945 ******* >2018-08-30 12:07:40,800 p=7972 u=mistral | skipping: [172.16.0.24] => (item=status) >2018-08-30 12:07:40,832 p=7972 u=mistral | TASK [ceph-mgr : add modules to ceph-mgr] ************************************** >2018-08-30 12:07:40,832 p=7972 u=mistral | Thursday 30 August 2018 12:07:40 -0400 (0:00:00.067) 0:05:27.012 ******* >2018-08-30 12:07:40,866 p=7972 u=mistral | skipping: [172.16.0.24] => (item=status) >2018-08-30 12:07:40,868 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:07:40,869 p=7972 u=mistral | Thursday 30 August 2018 12:07:40 -0400 (0:00:00.036) 0:05:27.049 ******* >2018-08-30 12:07:41,112 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:41,113 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:07:41,113 p=7972 u=mistral | Thursday 30 August 2018 12:07:41 -0400 (0:00:00.244) 0:05:27.293 ******* >2018-08-30 12:07:42,108 p=7972 u=mistral | changed: [172.16.0.24] >2018-08-30 12:07:42,109 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:07:42,109 p=7972 u=mistral | Thursday 30 August 2018 12:07:42 -0400 (0:00:00.996) 0:05:28.290 ******* >2018-08-30 12:07:42,201 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:07:42,211 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:07:42,221 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:07:42,223 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:07:42,223 p=7972 u=mistral | Thursday 30 August 2018 12:07:42 -0400 (0:00:00.113) 0:05:28.403 ******* >2018-08-30 12:07:42,357 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:07:42,397 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:07:42,434 p=7972 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:07:42,435 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:07:42,436 p=7972 u=mistral | Thursday 30 August 2018 12:07:42 -0400 (0:00:00.212) 0:05:28.616 ******* >2018-08-30 12:07:42,666 p=7972 u=mistral | ok: [172.16.0.24] >2018-08-30 12:07:42,690 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph mgr] ************** >2018-08-30 12:07:42,900 p=7972 u=mistral | TASK [stop non-containerized ceph mgr(s)] ************************************** >2018-08-30 12:07:42,900 p=7972 u=mistral | Thursday 30 August 2018 12:07:42 -0400 (0:00:00.464) 0:05:29.080 ******* >2018-08-30 12:07:43,307 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:43,321 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:07:43,321 p=7972 u=mistral | Thursday 30 August 2018 12:07:43 -0400 (0:00:00.420) 0:05:29.501 ******* >2018-08-30 12:07:43,353 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:43,367 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:07:43,368 p=7972 u=mistral | Thursday 30 August 2018 12:07:43 -0400 (0:00:00.046) 0:05:29.548 ******* >2018-08-30 12:07:43,445 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:43,462 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:07:43,462 p=7972 u=mistral | Thursday 30 August 2018 12:07:43 -0400 (0:00:00.094) 0:05:29.642 ******* >2018-08-30 12:07:43,872 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph) >2018-08-30 12:07:44,174 p=7972 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:07:44,189 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:07:44,190 p=7972 u=mistral | Thursday 30 August 2018 12:07:44 -0400 (0:00:00.727) 0:05:30.370 ******* >2018-08-30 12:07:44,572 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:44,590 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:07:44,591 p=7972 u=mistral | Thursday 30 August 2018 12:07:44 -0400 (0:00:00.401) 0:05:30.771 ******* >2018-08-30 12:07:44,622 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:44,637 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:07:44,637 p=7972 u=mistral | Thursday 30 August 2018 12:07:44 -0400 (0:00:00.046) 0:05:30.817 ******* >2018-08-30 12:07:44,671 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:44,687 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:07:44,688 p=7972 u=mistral | Thursday 30 August 2018 12:07:44 -0400 (0:00:00.050) 0:05:30.868 ******* >2018-08-30 12:07:44,722 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:44,739 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:07:44,740 p=7972 u=mistral | Thursday 30 August 2018 12:07:44 -0400 (0:00:00.051) 0:05:30.920 ******* >2018-08-30 12:07:45,166 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:45,186 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:07:45,187 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.446) 0:05:31.367 ******* >2018-08-30 12:07:45,222 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,241 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:07:45,241 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.054) 0:05:31.421 ******* >2018-08-30 12:07:45,286 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,302 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:07:45,303 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.061) 0:05:31.483 ******* >2018-08-30 12:07:45,331 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,348 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:07:45,349 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.046) 0:05:31.529 ******* >2018-08-30 12:07:45,385 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,401 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:07:45,401 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.052) 0:05:31.581 ******* >2018-08-30 12:07:45,432 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,447 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:07:45,448 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.046) 0:05:31.628 ******* >2018-08-30 12:07:45,483 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,501 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:07:45,501 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.053) 0:05:31.682 ******* >2018-08-30 12:07:45,532 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,548 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:07:45,549 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.047) 0:05:31.729 ******* >2018-08-30 12:07:45,580 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,598 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:07:45,598 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.049) 0:05:31.778 ******* >2018-08-30 12:07:45,630 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,646 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:07:45,646 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.048) 0:05:31.826 ******* >2018-08-30 12:07:45,677 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,693 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:07:45,693 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.046) 0:05:31.873 ******* >2018-08-30 12:07:45,729 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,744 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:07:45,744 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.051) 0:05:31.924 ******* >2018-08-30 12:07:45,773 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,788 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:07:45,788 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.043) 0:05:31.968 ******* >2018-08-30 12:07:45,820 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,835 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:07:45,835 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.046) 0:05:32.015 ******* >2018-08-30 12:07:45,864 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,879 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:07:45,879 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.043) 0:05:32.059 ******* >2018-08-30 12:07:45,910 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,924 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:07:45,925 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.045) 0:05:32.105 ******* >2018-08-30 12:07:45,952 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:45,970 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:07:45,970 p=7972 u=mistral | Thursday 30 August 2018 12:07:45 -0400 (0:00:00.045) 0:05:32.150 ******* >2018-08-30 12:07:46,003 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,018 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:07:46,018 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.048) 0:05:32.198 ******* >2018-08-30 12:07:46,050 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,065 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:07:46,065 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.046) 0:05:32.245 ******* >2018-08-30 12:07:46,097 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,116 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:07:46,116 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.050) 0:05:32.296 ******* >2018-08-30 12:07:46,145 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,161 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:07:46,161 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.045) 0:05:32.341 ******* >2018-08-30 12:07:46,192 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,207 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:07:46,207 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.045) 0:05:32.387 ******* >2018-08-30 12:07:46,241 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,254 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:07:46,254 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.047) 0:05:32.434 ******* >2018-08-30 12:07:46,287 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,307 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:07:46,307 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.052) 0:05:32.487 ******* >2018-08-30 12:07:46,654 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:46,668 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:07:46,669 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.361) 0:05:32.849 ******* >2018-08-30 12:07:46,740 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:46,758 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:07:46,758 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.089) 0:05:32.938 ******* >2018-08-30 12:07:46,819 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:46,833 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:07:46,834 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.075) 0:05:33.014 ******* >2018-08-30 12:07:46,863 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:46,896 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:07:46,896 p=7972 u=mistral | Thursday 30 August 2018 12:07:46 -0400 (0:00:00.062) 0:05:33.076 ******* >2018-08-30 12:07:47,001 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:07:47,043 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:07:47,044 p=7972 u=mistral | Thursday 30 August 2018 12:07:47 -0400 (0:00:00.147) 0:05:33.224 ******* >2018-08-30 12:07:47,913 p=7972 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:07:47,937 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:07:47,937 p=7972 u=mistral | Thursday 30 August 2018 12:07:47 -0400 (0:00:00.892) 0:05:34.117 ******* >2018-08-30 12:07:48,199 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:07:48,215 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:07:48,215 p=7972 u=mistral | Thursday 30 August 2018 12:07:48 -0400 (0:00:00.277) 0:05:34.395 ******* >2018-08-30 12:07:48,249 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:48,269 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:07:48,270 p=7972 u=mistral | Thursday 30 August 2018 12:07:48 -0400 (0:00:00.054) 0:05:34.450 ******* >2018-08-30 12:07:48,522 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:07:48,543 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:07:48,544 p=7972 u=mistral | Thursday 30 August 2018 12:07:48 -0400 (0:00:00.274) 0:05:34.724 ******* >2018-08-30 12:07:48,624 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:48,642 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:07:48,642 p=7972 u=mistral | Thursday 30 August 2018 12:07:48 -0400 (0:00:00.098) 0:05:34.822 ******* >2018-08-30 12:07:48,705 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:48,726 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:07:48,727 p=7972 u=mistral | Thursday 30 August 2018 12:07:48 -0400 (0:00:00.084) 0:05:34.907 ******* >2018-08-30 12:07:48,750 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:48,769 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:07:48,769 p=7972 u=mistral | Thursday 30 August 2018 12:07:48 -0400 (0:00:00.042) 0:05:34.949 ******* >2018-08-30 12:07:49,007 p=7972 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:07:49,024 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:07:49,025 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.255) 0:05:35.205 ******* >2018-08-30 12:07:49,053 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,068 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:07:49,068 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.043) 0:05:35.248 ******* >2018-08-30 12:07:49,091 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,107 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:07:49,107 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.039) 0:05:35.287 ******* >2018-08-30 12:07:49,168 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:49,184 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:07:49,184 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.076) 0:05:35.364 ******* >2018-08-30 12:07:49,208 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,229 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:07:49,229 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.045) 0:05:35.409 ******* >2018-08-30 12:07:49,259 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,275 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:07:49,275 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.045) 0:05:35.455 ******* >2018-08-30 12:07:49,300 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,314 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:07:49,315 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.039) 0:05:35.495 ******* >2018-08-30 12:07:49,344 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,363 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:07:49,363 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.048) 0:05:35.544 ******* >2018-08-30 12:07:49,410 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/dev/vdb) >2018-08-30 12:07:49,427 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:07:49,428 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.064) 0:05:35.608 ******* >2018-08-30 12:07:49,467 p=7972 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:07:49,485 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:07:49,485 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.057) 0:05:35.665 ******* >2018-08-30 12:07:49,513 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,528 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:07:49,528 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.043) 0:05:35.709 ******* >2018-08-30 12:07:49,560 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,574 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:07:49,574 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.045) 0:05:35.754 ******* >2018-08-30 12:07:49,606 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,622 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:07:49,622 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.048) 0:05:35.803 ******* >2018-08-30 12:07:49,659 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,675 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:07:49,676 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.053) 0:05:35.856 ******* >2018-08-30 12:07:49,711 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:49,727 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:07:49,727 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.051) 0:05:35.907 ******* >2018-08-30 12:07:49,801 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:49,822 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:07:49,822 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.094) 0:05:36.002 ******* >2018-08-30 12:07:49,889 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:49,904 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:07:49,904 p=7972 u=mistral | Thursday 30 August 2018 12:07:49 -0400 (0:00:00.082) 0:05:36.085 ******* >2018-08-30 12:07:50,263 p=7972 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:07:50,547 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/) >2018-08-30 12:07:50,854 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mon) >2018-08-30 12:07:51,137 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/osd) >2018-08-30 12:07:51,443 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mds) >2018-08-30 12:07:51,739 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/tmp) >2018-08-30 12:07:52,017 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:07:52,456 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:07:52,738 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:07:53,036 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:07:53,320 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:07:53,643 p=7972 u=mistral | ok: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:07:53,663 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:07:53,663 p=7972 u=mistral | Thursday 30 August 2018 12:07:53 -0400 (0:00:03.759) 0:05:39.844 ******* >2018-08-30 12:07:53,692 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:53,706 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:07:53,707 p=7972 u=mistral | Thursday 30 August 2018 12:07:53 -0400 (0:00:00.043) 0:05:39.887 ******* >2018-08-30 12:07:53,744 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:53,759 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:07:53,759 p=7972 u=mistral | Thursday 30 August 2018 12:07:53 -0400 (0:00:00.052) 0:05:39.939 ******* >2018-08-30 12:07:53,789 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:53,804 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:07:53,804 p=7972 u=mistral | Thursday 30 August 2018 12:07:53 -0400 (0:00:00.044) 0:05:39.984 ******* >2018-08-30 12:07:54,141 p=7972 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:07:54,442 p=7972 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:07:54,457 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:07:54,457 p=7972 u=mistral | Thursday 30 August 2018 12:07:54 -0400 (0:00:00.653) 0:05:40.638 ******* >2018-08-30 12:07:54,525 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:54,541 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:07:54,541 p=7972 u=mistral | Thursday 30 August 2018 12:07:54 -0400 (0:00:00.083) 0:05:40.721 ******* >2018-08-30 12:07:54,563 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:54,576 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:07:54,577 p=7972 u=mistral | Thursday 30 August 2018 12:07:54 -0400 (0:00:00.035) 0:05:40.757 ******* >2018-08-30 12:07:54,943 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:54,959 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:07:54,959 p=7972 u=mistral | Thursday 30 August 2018 12:07:54 -0400 (0:00:00.382) 0:05:41.139 ******* >2018-08-30 12:07:55,015 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:55,031 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:07:55,031 p=7972 u=mistral | Thursday 30 August 2018 12:07:55 -0400 (0:00:00.072) 0:05:41.212 ******* >2018-08-30 12:07:55,408 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:55,422 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:07:55,422 p=7972 u=mistral | Thursday 30 August 2018 12:07:55 -0400 (0:00:00.390) 0:05:41.602 ******* >2018-08-30 12:07:55,458 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:55,472 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:07:55,473 p=7972 u=mistral | Thursday 30 August 2018 12:07:55 -0400 (0:00:00.050) 0:05:41.653 ******* >2018-08-30 12:07:55,522 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:07:55,540 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:07:55,560 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:07:55,576 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:07:55,576 p=7972 u=mistral | Thursday 30 August 2018 12:07:55 -0400 (0:00:00.103) 0:05:41.756 ******* >2018-08-30 12:07:55,627 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:55,644 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:07:55,644 p=7972 u=mistral | Thursday 30 August 2018 12:07:55 -0400 (0:00:00.067) 0:05:41.824 ******* >2018-08-30 12:07:55,683 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:55,705 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:07:55,705 p=7972 u=mistral | Thursday 30 August 2018 12:07:55 -0400 (0:00:00.061) 0:05:41.885 ******* >2018-08-30 12:07:55,749 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:07:55,766 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:07:55,781 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:07:55,798 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:07:55,817 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:07:55,834 p=7972 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:07:55,852 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:07:55,853 p=7972 u=mistral | Thursday 30 August 2018 12:07:55 -0400 (0:00:00.147) 0:05:42.033 ******* >2018-08-30 12:07:55,904 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:55,923 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mon.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:55,938 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:55,958 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:55,973 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:55,990 p=7972 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:07:56,007 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:07:56,008 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.155) 0:05:42.188 ******* >2018-08-30 12:07:56,032 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,048 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:07:56,049 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.040) 0:05:42.229 ******* >2018-08-30 12:07:56,075 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,090 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:07:56,090 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.041) 0:05:42.270 ******* >2018-08-30 12:07:56,123 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,138 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:07:56,138 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.048) 0:05:42.319 ******* >2018-08-30 12:07:56,174 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,189 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:07:56,189 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.050) 0:05:42.370 ******* >2018-08-30 12:07:56,226 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,241 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:07:56,242 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.052) 0:05:42.422 ******* >2018-08-30 12:07:56,271 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,286 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:07:56,287 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.045) 0:05:42.467 ******* >2018-08-30 12:07:56,316 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,330 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:07:56,331 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.043) 0:05:42.511 ******* >2018-08-30 12:07:56,360 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,374 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:07:56,374 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.043) 0:05:42.554 ******* >2018-08-30 12:07:56,800 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:56,826 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:07:56,827 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.452) 0:05:43.007 ******* >2018-08-30 12:07:56,857 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,872 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:07:56,873 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.045) 0:05:43.053 ******* >2018-08-30 12:07:56,904 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,919 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:07:56,919 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.045) 0:05:43.099 ******* >2018-08-30 12:07:56,950 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:56,966 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:07:56,966 p=7972 u=mistral | Thursday 30 August 2018 12:07:56 -0400 (0:00:00.047) 0:05:43.146 ******* >2018-08-30 12:07:57,005 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,022 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:07:57,022 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.056) 0:05:43.202 ******* >2018-08-30 12:07:57,049 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,068 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:07:57,068 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.045) 0:05:43.248 ******* >2018-08-30 12:07:57,101 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,116 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:07:57,117 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.048) 0:05:43.297 ******* >2018-08-30 12:07:57,484 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:57,507 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:07:57,507 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.390) 0:05:43.688 ******* >2018-08-30 12:07:57,545 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,562 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:07:57,562 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.054) 0:05:43.742 ******* >2018-08-30 12:07:57,595 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,611 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:07:57,612 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.049) 0:05:43.792 ******* >2018-08-30 12:07:57,642 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,657 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:07:57,657 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.045) 0:05:43.837 ******* >2018-08-30 12:07:57,692 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,710 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:07:57,710 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.052) 0:05:43.890 ******* >2018-08-30 12:07:57,737 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,752 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:07:57,752 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.042) 0:05:43.932 ******* >2018-08-30 12:07:57,784 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,798 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:07:57,798 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.046) 0:05:43.979 ******* >2018-08-30 12:07:57,869 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:57,885 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:07:57,885 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.086) 0:05:44.065 ******* >2018-08-30 12:07:57,915 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,931 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:07:57,932 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.046) 0:05:44.112 ******* >2018-08-30 12:07:57,959 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:57,975 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:07:57,976 p=7972 u=mistral | Thursday 30 August 2018 12:07:57 -0400 (0:00:00.043) 0:05:44.156 ******* >2018-08-30 12:07:58,006 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:58,023 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:07:58,023 p=7972 u=mistral | Thursday 30 August 2018 12:07:58 -0400 (0:00:00.047) 0:05:44.203 ******* >2018-08-30 12:07:58,059 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:58,074 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:07:58,074 p=7972 u=mistral | Thursday 30 August 2018 12:07:58 -0400 (0:00:00.050) 0:05:44.254 ******* >2018-08-30 12:07:58,108 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:58,128 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:07:58,129 p=7972 u=mistral | Thursday 30 August 2018 12:07:58 -0400 (0:00:00.054) 0:05:44.309 ******* >2018-08-30 12:07:58,159 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:58,184 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:07:58,184 p=7972 u=mistral | Thursday 30 August 2018 12:07:58 -0400 (0:00:00.054) 0:05:44.364 ******* >2018-08-30 12:07:58,571 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:58,594 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:07:58,595 p=7972 u=mistral | Thursday 30 August 2018 12:07:58 -0400 (0:00:00.410) 0:05:44.775 ******* >2018-08-30 12:07:58,968 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:07:58,988 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:07:58,988 p=7972 u=mistral | Thursday 30 August 2018 12:07:58 -0400 (0:00:00.393) 0:05:45.168 ******* >2018-08-30 12:07:59,054 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:07:59,068 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:07:59,068 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.080) 0:05:45.249 ******* >2018-08-30 12:07:59,111 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,126 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:07:59,126 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.057) 0:05:45.306 ******* >2018-08-30 12:07:59,155 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,170 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:07:59,170 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.044) 0:05:45.350 ******* >2018-08-30 12:07:59,200 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,215 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:07:59,216 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.045) 0:05:45.396 ******* >2018-08-30 12:07:59,246 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,259 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:07:59,259 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.043) 0:05:45.439 ******* >2018-08-30 12:07:59,293 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,307 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:07:59,307 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.048) 0:05:45.487 ******* >2018-08-30 12:07:59,338 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,354 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:07:59,354 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.046) 0:05:45.534 ******* >2018-08-30 12:07:59,385 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,413 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:07:59,413 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.059) 0:05:45.593 ******* >2018-08-30 12:07:59,445 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,466 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:07:59,467 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.053) 0:05:45.647 ******* >2018-08-30 12:07:59,498 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,515 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:07:59,515 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.048) 0:05:45.695 ******* >2018-08-30 12:07:59,547 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,563 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:07:59,563 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.047) 0:05:45.743 ******* >2018-08-30 12:07:59,593 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:07:59,610 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:07:59,610 p=7972 u=mistral | Thursday 30 August 2018 12:07:59 -0400 (0:00:00.047) 0:05:45.790 ******* >2018-08-30 12:08:00,708 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:00,723 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:08:00,723 p=7972 u=mistral | Thursday 30 August 2018 12:08:00 -0400 (0:00:01.113) 0:05:46.904 ******* >2018-08-30 12:08:00,782 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:00,798 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:08:00,798 p=7972 u=mistral | Thursday 30 August 2018 12:08:00 -0400 (0:00:00.074) 0:05:46.978 ******* >2018-08-30 12:08:00,829 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:00,846 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:08:00,846 p=7972 u=mistral | Thursday 30 August 2018 12:08:00 -0400 (0:00:00.048) 0:05:47.026 ******* >2018-08-30 12:08:00,874 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:00,890 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:08:00,890 p=7972 u=mistral | Thursday 30 August 2018 12:08:00 -0400 (0:00:00.043) 0:05:47.070 ******* >2018-08-30 12:08:00,949 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:00,963 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:08:00,963 p=7972 u=mistral | Thursday 30 August 2018 12:08:00 -0400 (0:00:00.073) 0:05:47.144 ******* >2018-08-30 12:08:00,993 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:01,007 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:08:01,008 p=7972 u=mistral | Thursday 30 August 2018 12:08:01 -0400 (0:00:00.044) 0:05:47.188 ******* >2018-08-30 12:08:01,043 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:01,056 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:08:01,056 p=7972 u=mistral | Thursday 30 August 2018 12:08:01 -0400 (0:00:00.048) 0:05:47.236 ******* >2018-08-30 12:08:01,382 p=7972 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:08:01,698 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:08:01,981 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:08:02,261 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:08:02,671 p=7972 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:08:02,688 p=7972 u=mistral | TASK [ceph-mgr : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:08:02,689 p=7972 u=mistral | Thursday 30 August 2018 12:08:02 -0400 (0:00:01.632) 0:05:48.869 ******* >2018-08-30 12:08:02,772 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:02,788 p=7972 u=mistral | TASK [ceph-mgr : create mgr directory] ***************************************** >2018-08-30 12:08:02,788 p=7972 u=mistral | Thursday 30 August 2018 12:08:02 -0400 (0:00:00.099) 0:05:48.968 ******* >2018-08-30 12:08:03,129 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:03,145 p=7972 u=mistral | TASK [ceph-mgr : copy ceph keyring(s) if needed] ******************************* >2018-08-30 12:08:03,145 p=7972 u=mistral | Thursday 30 August 2018 12:08:03 -0400 (0:00:00.357) 0:05:49.326 ******* >2018-08-30 12:08:04,011 p=7972 u=mistral | changed: [172.16.0.25] => (item={u'dest': u'/var/lib/ceph/mgr/ceph-lab-controller02/keyring', u'name': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'copy_key': True}) >2018-08-30 12:08:04,020 p=7972 u=mistral | skipping: [172.16.0.25] => (item={u'dest': u'/etc/ceph/ceph.client.admin.keyring', u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:08:04,038 p=7972 u=mistral | TASK [ceph-mgr : set mgr key permissions] ************************************** >2018-08-30 12:08:04,038 p=7972 u=mistral | Thursday 30 August 2018 12:08:04 -0400 (0:00:00.892) 0:05:50.218 ******* >2018-08-30 12:08:04,372 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:04,387 p=7972 u=mistral | TASK [ceph-mgr : install ceph-mgr package on RedHat or SUSE] ******************* >2018-08-30 12:08:04,387 p=7972 u=mistral | Thursday 30 August 2018 12:08:04 -0400 (0:00:00.348) 0:05:50.567 ******* >2018-08-30 12:08:04,415 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:04,429 p=7972 u=mistral | TASK [ceph-mgr : install ceph mgr for debian] ********************************** >2018-08-30 12:08:04,430 p=7972 u=mistral | Thursday 30 August 2018 12:08:04 -0400 (0:00:00.042) 0:05:50.610 ******* >2018-08-30 12:08:04,458 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:04,471 p=7972 u=mistral | TASK [ceph-mgr : ensure systemd service override directory exists] ************* >2018-08-30 12:08:04,471 p=7972 u=mistral | Thursday 30 August 2018 12:08:04 -0400 (0:00:00.041) 0:05:50.651 ******* >2018-08-30 12:08:04,497 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:04,511 p=7972 u=mistral | TASK [ceph-mgr : add ceph-mgr systemd service overrides] *********************** >2018-08-30 12:08:04,511 p=7972 u=mistral | Thursday 30 August 2018 12:08:04 -0400 (0:00:00.040) 0:05:50.692 ******* >2018-08-30 12:08:04,544 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:04,560 p=7972 u=mistral | TASK [ceph-mgr : start and add that the mgr service to the init sequence] ****** >2018-08-30 12:08:04,560 p=7972 u=mistral | Thursday 30 August 2018 12:08:04 -0400 (0:00:00.048) 0:05:50.740 ******* >2018-08-30 12:08:04,597 p=7972 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:08:04,612 p=7972 u=mistral | TASK [ceph-mgr : generate systemd unit file] *********************************** >2018-08-30 12:08:04,612 p=7972 u=mistral | Thursday 30 August 2018 12:08:04 -0400 (0:00:00.052) 0:05:50.793 ******* >2018-08-30 12:08:05,752 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:08:05,766 p=7972 u=mistral | TASK [ceph-mgr : systemd start mgr container] ********************************** >2018-08-30 12:08:05,767 p=7972 u=mistral | Thursday 30 August 2018 12:08:05 -0400 (0:00:01.154) 0:05:51.947 ******* >2018-08-30 12:08:06,714 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:08:06,743 p=7972 u=mistral | TASK [ceph-mgr : get enabled modules from ceph-mgr] **************************** >2018-08-30 12:08:06,743 p=7972 u=mistral | Thursday 30 August 2018 12:08:06 -0400 (0:00:00.976) 0:05:52.924 ******* >2018-08-30 12:08:07,611 p=7972 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:08:07,626 p=7972 u=mistral | TASK [ceph-mgr : set _ceph_mgr_modules fact] *********************************** >2018-08-30 12:08:07,626 p=7972 u=mistral | Thursday 30 August 2018 12:08:07 -0400 (0:00:00.882) 0:05:53.806 ******* >2018-08-30 12:08:07,686 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:07,716 p=7972 u=mistral | TASK [ceph-mgr : disable ceph mgr enabled modules] ***************************** >2018-08-30 12:08:07,717 p=7972 u=mistral | Thursday 30 August 2018 12:08:07 -0400 (0:00:00.090) 0:05:53.897 ******* >2018-08-30 12:08:07,756 p=7972 u=mistral | skipping: [172.16.0.25] => (item=status) >2018-08-30 12:08:07,785 p=7972 u=mistral | TASK [ceph-mgr : add modules to ceph-mgr] ************************************** >2018-08-30 12:08:07,785 p=7972 u=mistral | Thursday 30 August 2018 12:08:07 -0400 (0:00:00.068) 0:05:53.966 ******* >2018-08-30 12:08:07,823 p=7972 u=mistral | skipping: [172.16.0.25] => (item=status) >2018-08-30 12:08:07,827 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:08:07,827 p=7972 u=mistral | Thursday 30 August 2018 12:08:07 -0400 (0:00:00.041) 0:05:54.007 ******* >2018-08-30 12:08:07,896 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:07,897 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:08:07,897 p=7972 u=mistral | Thursday 30 August 2018 12:08:07 -0400 (0:00:00.070) 0:05:54.078 ******* >2018-08-30 12:08:08,724 p=7972 u=mistral | changed: [172.16.0.25] >2018-08-30 12:08:08,725 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:08:08,726 p=7972 u=mistral | Thursday 30 August 2018 12:08:08 -0400 (0:00:00.828) 0:05:54.906 ******* >2018-08-30 12:08:08,824 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:08:08,833 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:08:08,846 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:08:08,847 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:08:08,847 p=7972 u=mistral | Thursday 30 August 2018 12:08:08 -0400 (0:00:00.121) 0:05:55.028 ******* >2018-08-30 12:08:08,968 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:08:09,005 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:08:09,048 p=7972 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:08:09,050 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:08:09,050 p=7972 u=mistral | Thursday 30 August 2018 12:08:09 -0400 (0:00:00.202) 0:05:55.230 ******* >2018-08-30 12:08:09,119 p=7972 u=mistral | ok: [172.16.0.25] >2018-08-30 12:08:09,139 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph osd] ************** >2018-08-30 12:08:09,238 p=7972 u=mistral | TASK [collect running osds and ceph-disk unit(s)] ****************************** >2018-08-30 12:08:09,239 p=7972 u=mistral | Thursday 30 August 2018 12:08:09 -0400 (0:00:00.188) 0:05:55.419 ******* >2018-08-30 12:08:09,627 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:09,640 p=7972 u=mistral | TASK [collect osd devices] ***************************************************** >2018-08-30 12:08:09,640 p=7972 u=mistral | Thursday 30 August 2018 12:08:09 -0400 (0:00:00.401) 0:05:55.820 ******* >2018-08-30 12:08:09,672 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:09,684 p=7972 u=mistral | TASK [set devices] ************************************************************* >2018-08-30 12:08:09,684 p=7972 u=mistral | Thursday 30 August 2018 12:08:09 -0400 (0:00:00.043) 0:05:55.864 ******* >2018-08-30 12:08:09,710 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:09,723 p=7972 u=mistral | TASK [stop/disable/mask non-containerized ceph osd(s) and ceph-disk units (if any)] *** >2018-08-30 12:08:09,724 p=7972 u=mistral | Thursday 30 August 2018 12:08:09 -0400 (0:00:00.039) 0:05:55.904 ******* >2018-08-30 12:08:12,536 p=7972 u=mistral | changed: [172.16.0.28] => (item=ceph-osd@0.service) >2018-08-30 12:08:12,553 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:08:12,553 p=7972 u=mistral | Thursday 30 August 2018 12:08:12 -0400 (0:00:02.829) 0:05:58.733 ******* >2018-08-30 12:08:12,586 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:12,599 p=7972 u=mistral | TASK [set_fact ceph_uid for red hat] ******************************************* >2018-08-30 12:08:12,600 p=7972 u=mistral | Thursday 30 August 2018 12:08:12 -0400 (0:00:00.046) 0:05:58.780 ******* >2018-08-30 12:08:12,635 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:12,647 p=7972 u=mistral | TASK [set_fact ceph_uid for rhel] ********************************************** >2018-08-30 12:08:12,647 p=7972 u=mistral | Thursday 30 August 2018 12:08:12 -0400 (0:00:00.047) 0:05:58.827 ******* >2018-08-30 12:08:12,706 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:12,717 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:08:12,717 p=7972 u=mistral | Thursday 30 August 2018 12:08:12 -0400 (0:00:00.070) 0:05:58.898 ******* >2018-08-30 12:08:14,468 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph) >2018-08-30 12:08:14,912 p=7972 u=mistral | changed: [172.16.0.28] => (item=/etc/ceph) >2018-08-30 12:08:14,926 p=7972 u=mistral | TASK [check for existing old leveldb file extension (ldb)] ********************* >2018-08-30 12:08:14,926 p=7972 u=mistral | Thursday 30 August 2018 12:08:14 -0400 (0:00:02.208) 0:06:01.106 ******* >2018-08-30 12:08:15,244 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:15,257 p=7972 u=mistral | TASK [rename leveldb extension from ldb to sst] ******************************** >2018-08-30 12:08:15,257 p=7972 u=mistral | Thursday 30 August 2018 12:08:15 -0400 (0:00:00.331) 0:06:01.437 ******* >2018-08-30 12:08:15,281 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:15,295 p=7972 u=mistral | TASK [check if containerized osds are already running] ************************* >2018-08-30 12:08:15,295 p=7972 u=mistral | Thursday 30 August 2018 12:08:15 -0400 (0:00:00.038) 0:06:01.475 ******* >2018-08-30 12:08:15,667 p=7972 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:08:15,680 p=7972 u=mistral | TASK [resolve device(s) path(s)] *********************************************** >2018-08-30 12:08:15,681 p=7972 u=mistral | Thursday 30 August 2018 12:08:15 -0400 (0:00:00.385) 0:06:01.861 ******* >2018-08-30 12:08:16,005 p=7972 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:08:16,018 p=7972 u=mistral | TASK [unmount all the osd directories] ***************************************** >2018-08-30 12:08:16,018 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.337) 0:06:02.198 ******* >2018-08-30 12:08:16,357 p=7972 u=mistral | ok: [172.16.0.28] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'end': u'2018-08-30 12:08:16.958360', '_ansible_no_log': False, u'stdout': u'/dev/vdb', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.006460', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:08:16.951900', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'docker ps | grep -sq devvdb', u'end': u'2018-08-30 12:08:16.620480', '_ansible_no_log': False, u'stdout': u'', '_ansible_item_result': True, u'changed': False, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u'docker ps | grep -sq devvdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2018-08-30 12:08:16.567758', u'delta': u'0:00:00.052722', 'item': u'/dev/vdb', u'rc': 1, u'msg': u'non-zero return code', 'stdout_lines': [], 'failed_when_result': False, u'stderr': u'', '_ansible_ignore_errors': None, u'failed': False}]) >2018-08-30 12:08:16,375 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:08:16,376 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.357) 0:06:02.556 ******* >2018-08-30 12:08:16,407 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:16,422 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:08:16,422 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.046) 0:06:02.603 ******* >2018-08-30 12:08:16,765 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:16,779 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:08:16,780 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.357) 0:06:02.960 ******* >2018-08-30 12:08:16,814 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:16,827 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:08:16,827 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.047) 0:06:03.007 ******* >2018-08-30 12:08:16,858 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:16,872 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:08:16,872 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.045) 0:06:03.052 ******* >2018-08-30 12:08:16,904 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:16,919 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:08:16,919 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.046) 0:06:03.099 ******* >2018-08-30 12:08:16,951 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:16,966 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:08:16,966 p=7972 u=mistral | Thursday 30 August 2018 12:08:16 -0400 (0:00:00.046) 0:06:03.146 ******* >2018-08-30 12:08:16,995 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,009 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:08:17,009 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.043) 0:06:03.190 ******* >2018-08-30 12:08:17,034 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,047 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:08:17,047 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.038) 0:06:03.228 ******* >2018-08-30 12:08:17,075 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,087 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:08:17,088 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.040) 0:06:03.268 ******* >2018-08-30 12:08:17,117 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,129 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:08:17,130 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.041) 0:06:03.310 ******* >2018-08-30 12:08:17,163 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,175 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:08:17,175 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.045) 0:06:03.356 ******* >2018-08-30 12:08:17,202 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,214 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:08:17,214 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.038) 0:06:03.394 ******* >2018-08-30 12:08:17,238 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,258 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:08:17,259 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.044) 0:06:03.439 ******* >2018-08-30 12:08:17,289 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,307 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:08:17,307 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.048) 0:06:03.487 ******* >2018-08-30 12:08:17,336 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,357 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:08:17,357 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.050) 0:06:03.537 ******* >2018-08-30 12:08:17,386 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,400 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:08:17,400 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.042) 0:06:03.580 ******* >2018-08-30 12:08:17,428 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,442 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:08:17,442 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.042) 0:06:03.622 ******* >2018-08-30 12:08:17,471 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,486 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:08:17,487 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.044) 0:06:03.667 ******* >2018-08-30 12:08:17,523 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,545 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:08:17,545 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.058) 0:06:03.725 ******* >2018-08-30 12:08:17,579 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,593 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:08:17,593 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.047) 0:06:03.773 ******* >2018-08-30 12:08:17,631 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,644 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:08:17,644 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.050) 0:06:03.824 ******* >2018-08-30 12:08:17,673 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,686 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:08:17,686 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.042) 0:06:03.867 ******* >2018-08-30 12:08:17,714 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,726 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:08:17,726 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.039) 0:06:03.906 ******* >2018-08-30 12:08:17,755 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,768 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:08:17,769 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.042) 0:06:03.949 ******* >2018-08-30 12:08:17,798 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,810 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:08:17,810 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.041) 0:06:03.991 ******* >2018-08-30 12:08:17,847 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,861 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:08:17,861 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.050) 0:06:04.041 ******* >2018-08-30 12:08:17,889 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,902 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:08:17,903 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.041) 0:06:04.083 ******* >2018-08-30 12:08:17,931 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:17,944 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:08:17,945 p=7972 u=mistral | Thursday 30 August 2018 12:08:17 -0400 (0:00:00.042) 0:06:04.125 ******* >2018-08-30 12:08:18,291 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:18,304 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:08:18,305 p=7972 u=mistral | Thursday 30 August 2018 12:08:18 -0400 (0:00:00.359) 0:06:04.485 ******* >2018-08-30 12:08:18,377 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:18,396 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:08:18,396 p=7972 u=mistral | Thursday 30 August 2018 12:08:18 -0400 (0:00:00.091) 0:06:04.576 ******* >2018-08-30 12:08:18,458 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:18,473 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:08:18,474 p=7972 u=mistral | Thursday 30 August 2018 12:08:18 -0400 (0:00:00.077) 0:06:04.654 ******* >2018-08-30 12:08:18,505 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:18,539 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:08:18,540 p=7972 u=mistral | Thursday 30 August 2018 12:08:18 -0400 (0:00:00.066) 0:06:04.720 ******* >2018-08-30 12:08:18,666 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.33] >2018-08-30 12:08:18,695 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:08:18,695 p=7972 u=mistral | Thursday 30 August 2018 12:08:18 -0400 (0:00:00.155) 0:06:04.875 ******* >2018-08-30 12:08:19,655 p=7972 u=mistral | ok: [172.16.0.28 -> 172.16.0.33] >2018-08-30 12:08:19,677 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:08:19,677 p=7972 u=mistral | Thursday 30 August 2018 12:08:19 -0400 (0:00:00.982) 0:06:05.858 ******* >2018-08-30 12:08:19,915 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] >2018-08-30 12:08:19,936 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:08:19,936 p=7972 u=mistral | Thursday 30 August 2018 12:08:19 -0400 (0:00:00.258) 0:06:06.116 ******* >2018-08-30 12:08:19,968 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:19,986 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:08:19,987 p=7972 u=mistral | Thursday 30 August 2018 12:08:19 -0400 (0:00:00.050) 0:06:06.167 ******* >2018-08-30 12:08:20,241 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] >2018-08-30 12:08:20,257 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:08:20,258 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.270) 0:06:06.438 ******* >2018-08-30 12:08:20,321 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:20,345 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:08:20,345 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.087) 0:06:06.525 ******* >2018-08-30 12:08:20,407 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:20,433 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:08:20,433 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.088) 0:06:06.614 ******* >2018-08-30 12:08:20,458 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:20,477 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:08:20,477 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.043) 0:06:06.657 ******* >2018-08-30 12:08:20,711 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] >2018-08-30 12:08:20,738 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:08:20,738 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.260) 0:06:06.918 ******* >2018-08-30 12:08:20,764 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:20,777 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:08:20,778 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.039) 0:06:06.958 ******* >2018-08-30 12:08:20,802 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:20,819 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:08:20,820 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.042) 0:06:07.000 ******* >2018-08-30 12:08:20,887 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:20,901 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:08:20,901 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.081) 0:06:07.082 ******* >2018-08-30 12:08:20,927 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:20,940 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:08:20,941 p=7972 u=mistral | Thursday 30 August 2018 12:08:20 -0400 (0:00:00.039) 0:06:07.121 ******* >2018-08-30 12:08:21,006 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:21,018 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:08:21,018 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.077) 0:06:07.199 ******* >2018-08-30 12:08:21,084 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:21,096 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:08:21,097 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.078) 0:06:07.277 ******* >2018-08-30 12:08:21,168 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:21,180 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:08:21,180 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.083) 0:06:07.360 ******* >2018-08-30 12:08:21,534 p=7972 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:08:21,550 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:08:21,551 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.370) 0:06:07.731 ******* >2018-08-30 12:08:21,635 p=7972 u=mistral | ok: [172.16.0.28] => (item={'_ansible_parsed': True, 'stderr_lines': [], '_ansible_item_result': True, u'end': u'2018-08-30 12:08:22.484174', '_ansible_no_log': False, u'stdout': u'/dev/vdb', u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'rc': 0, 'item': u'/dev/vdb', u'delta': u'0:00:00.005345', u'stderr': u'', u'changed': False, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:08:22.478829', '_ansible_ignore_errors': None, 'failed': False}) >2018-08-30 12:08:21,652 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:08:21,652 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.101) 0:06:07.832 ******* >2018-08-30 12:08:21,726 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:21,742 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:08:21,742 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.090) 0:06:07.922 ******* >2018-08-30 12:08:21,776 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:21,792 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:08:21,793 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.050) 0:06:07.973 ******* >2018-08-30 12:08:21,820 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:21,835 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:08:21,836 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.042) 0:06:08.016 ******* >2018-08-30 12:08:21,865 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:21,877 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:08:21,877 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.041) 0:06:08.058 ******* >2018-08-30 12:08:21,907 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:21,919 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:08:21,920 p=7972 u=mistral | Thursday 30 August 2018 12:08:21 -0400 (0:00:00.042) 0:06:08.100 ******* >2018-08-30 12:08:21,987 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:22,000 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:08:22,001 p=7972 u=mistral | Thursday 30 August 2018 12:08:22 -0400 (0:00:00.080) 0:06:08.181 ******* >2018-08-30 12:08:22,056 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:22,070 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:08:22,070 p=7972 u=mistral | Thursday 30 August 2018 12:08:22 -0400 (0:00:00.069) 0:06:08.250 ******* >2018-08-30 12:08:22,398 p=7972 u=mistral | changed: [172.16.0.28] => (item=/etc/ceph) >2018-08-30 12:08:22,822 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/) >2018-08-30 12:08:23,131 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/mon) >2018-08-30 12:08:23,408 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/osd) >2018-08-30 12:08:23,680 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/mds) >2018-08-30 12:08:23,972 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/tmp) >2018-08-30 12:08:24,246 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:08:24,535 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:08:24,819 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:08:25,129 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:08:25,436 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:08:25,725 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/run/ceph) >2018-08-30 12:08:25,748 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:08:25,748 p=7972 u=mistral | Thursday 30 August 2018 12:08:25 -0400 (0:00:03.678) 0:06:11.929 ******* >2018-08-30 12:08:25,775 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:25,789 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:08:25,789 p=7972 u=mistral | Thursday 30 August 2018 12:08:25 -0400 (0:00:00.040) 0:06:11.969 ******* >2018-08-30 12:08:25,815 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:25,829 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:08:25,830 p=7972 u=mistral | Thursday 30 August 2018 12:08:25 -0400 (0:00:00.040) 0:06:12.010 ******* >2018-08-30 12:08:25,860 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:25,874 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:08:25,874 p=7972 u=mistral | Thursday 30 August 2018 12:08:25 -0400 (0:00:00.044) 0:06:12.054 ******* >2018-08-30 12:08:26,215 p=7972 u=mistral | changed: [172.16.0.28] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:08:26,512 p=7972 u=mistral | changed: [172.16.0.28] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:08:26,526 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:08:26,527 p=7972 u=mistral | Thursday 30 August 2018 12:08:26 -0400 (0:00:00.652) 0:06:12.707 ******* >2018-08-30 12:08:26,592 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:26,605 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:08:26,605 p=7972 u=mistral | Thursday 30 August 2018 12:08:26 -0400 (0:00:00.078) 0:06:12.785 ******* >2018-08-30 12:08:26,628 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:26,640 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:08:26,640 p=7972 u=mistral | Thursday 30 August 2018 12:08:26 -0400 (0:00:00.035) 0:06:12.820 ******* >2018-08-30 12:08:27,010 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:27,026 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:08:27,026 p=7972 u=mistral | Thursday 30 August 2018 12:08:27 -0400 (0:00:00.385) 0:06:13.206 ******* >2018-08-30 12:08:27,084 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:27,096 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:08:27,096 p=7972 u=mistral | Thursday 30 August 2018 12:08:27 -0400 (0:00:00.070) 0:06:13.277 ******* >2018-08-30 12:08:27,456 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:27,470 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:08:27,470 p=7972 u=mistral | Thursday 30 August 2018 12:08:27 -0400 (0:00:00.373) 0:06:13.650 ******* >2018-08-30 12:08:27,576 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:27,589 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:08:27,589 p=7972 u=mistral | Thursday 30 August 2018 12:08:27 -0400 (0:00:00.118) 0:06:13.769 ******* >2018-08-30 12:08:27,779 p=7972 u=mistral | ok: [172.16.0.28] => (item=172.16.0.33) >2018-08-30 12:08:27,907 p=7972 u=mistral | ok: [172.16.0.28] => (item=172.16.0.24) >2018-08-30 12:08:28,185 p=7972 u=mistral | ok: [172.16.0.28] => (item=172.16.0.25) >2018-08-30 12:08:28,200 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:08:28,201 p=7972 u=mistral | Thursday 30 August 2018 12:08:28 -0400 (0:00:00.611) 0:06:14.381 ******* >2018-08-30 12:08:28,304 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:28,327 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:08:28,328 p=7972 u=mistral | Thursday 30 August 2018 12:08:28 -0400 (0:00:00.126) 0:06:14.508 ******* >2018-08-30 12:08:28,437 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:28,460 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:08:28,460 p=7972 u=mistral | Thursday 30 August 2018 12:08:28 -0400 (0:00:00.132) 0:06:14.640 ******* >2018-08-30 12:08:28,803 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:08:29,076 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/etc/ceph/monmap-ceph) >2018-08-30 12:08:29,364 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:08:29,649 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:08:29,923 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:08:30,240 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:08:30,518 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:08:30,803 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller03.keyring) >2018-08-30 12:08:31,080 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller01.keyring) >2018-08-30 12:08:31,366 p=7972 u=mistral | ok: [172.16.0.28 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller02.keyring) >2018-08-30 12:08:31,390 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:08:31,390 p=7972 u=mistral | Thursday 30 August 2018 12:08:31 -0400 (0:00:02.929) 0:06:17.570 ******* >2018-08-30 12:08:31,497 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:31,557 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/etc/ceph/monmap-ceph', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/monmap-ceph', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/monmap-ceph', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:31,623 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:31,684 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:31,741 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:31,807 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:31,874 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:31,938 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/etc/ceph/ceph.mgr.lab-controller03.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645199.971, u'block_size': 4096, u'inode': 50344677, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'xusr': False, u'atime': 1535645224.152, u'md5': u'855b52e842439169d0faee60df11c0de', u'isdir': False, u'ctime': 1535645199.971, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'14c1cb46b68d2b51f1dfa491346254a203cb0ff1', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:32,005 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/etc/ceph/ceph.mgr.lab-controller01.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645200.324, u'block_size': 4096, u'inode': 50344678, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'xusr': False, u'atime': 1535645255.581, u'md5': u'766ce60e91448f0c196c1303c2d6a7c4', u'isdir': False, u'ctime': 1535645200.324, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'42599b981d04addb5046bb792a7d4bd1f767ab8b', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:32,071 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'/etc/ceph/ceph.mgr.lab-controller02.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645200.68, u'block_size': 4096, u'inode': 50344679, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'xusr': False, u'atime': 1535645283.235, u'md5': u'516246c66efdfb30f97b8e6819caa58e', u'isdir': False, u'ctime': 1535645200.68, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'2697a3cfce227670e9c71655817435acb758f3a6', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:08:32,095 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:08:32,096 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.705) 0:06:18.276 ******* >2018-08-30 12:08:32,121 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,134 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:08:32,134 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.038) 0:06:18.315 ******* >2018-08-30 12:08:32,158 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,171 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:08:32,171 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.036) 0:06:18.351 ******* >2018-08-30 12:08:32,206 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,221 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:08:32,221 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.050) 0:06:18.402 ******* >2018-08-30 12:08:32,254 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,266 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:08:32,266 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.044) 0:06:18.446 ******* >2018-08-30 12:08:32,295 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,312 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:08:32,312 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.045) 0:06:18.492 ******* >2018-08-30 12:08:32,341 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,356 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:08:32,356 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.044) 0:06:18.537 ******* >2018-08-30 12:08:32,387 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,400 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:08:32,401 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.044) 0:06:18.581 ******* >2018-08-30 12:08:32,430 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,442 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:08:32,442 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.041) 0:06:18.622 ******* >2018-08-30 12:08:32,470 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,483 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:08:32,483 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.041) 0:06:18.663 ******* >2018-08-30 12:08:32,520 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,532 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:08:32,532 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.049) 0:06:18.712 ******* >2018-08-30 12:08:32,560 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,573 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:08:32,574 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.041) 0:06:18.754 ******* >2018-08-30 12:08:32,603 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,616 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:08:32,616 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.042) 0:06:18.796 ******* >2018-08-30 12:08:32,648 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,661 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:08:32,661 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.045) 0:06:18.842 ******* >2018-08-30 12:08:32,691 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,706 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:08:32,706 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.044) 0:06:18.887 ******* >2018-08-30 12:08:32,742 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,756 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:08:32,757 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.050) 0:06:18.937 ******* >2018-08-30 12:08:32,784 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,799 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:08:32,799 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.042) 0:06:18.979 ******* >2018-08-30 12:08:32,831 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,843 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:08:32,844 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.044) 0:06:19.024 ******* >2018-08-30 12:08:32,874 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,887 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:08:32,888 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.044) 0:06:19.068 ******* >2018-08-30 12:08:32,916 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,930 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:08:32,930 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.042) 0:06:19.110 ******* >2018-08-30 12:08:32,956 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:32,969 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:08:32,970 p=7972 u=mistral | Thursday 30 August 2018 12:08:32 -0400 (0:00:00.039) 0:06:19.150 ******* >2018-08-30 12:08:32,999 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,013 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:08:33,013 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.043) 0:06:19.193 ******* >2018-08-30 12:08:33,039 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,054 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:08:33,054 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.041) 0:06:19.234 ******* >2018-08-30 12:08:33,083 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,099 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:08:33,099 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.044) 0:06:19.279 ******* >2018-08-30 12:08:33,131 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,143 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:08:33,144 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.044) 0:06:19.324 ******* >2018-08-30 12:08:33,169 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,182 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:08:33,182 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.038) 0:06:19.363 ******* >2018-08-30 12:08:33,208 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,221 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:08:33,221 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.039) 0:06:19.402 ******* >2018-08-30 12:08:33,248 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,260 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:08:33,261 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.039) 0:06:19.441 ******* >2018-08-30 12:08:33,287 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,299 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:08:33,300 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.038) 0:06:19.480 ******* >2018-08-30 12:08:33,327 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:33,341 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:08:33,342 p=7972 u=mistral | Thursday 30 August 2018 12:08:33 -0400 (0:00:00.041) 0:06:19.522 ******* >2018-08-30 12:08:54,631 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:54,653 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:08:54,654 p=7972 u=mistral | Thursday 30 August 2018 12:08:54 -0400 (0:00:21.312) 0:06:40.834 ******* >2018-08-30 12:08:55,032 p=7972 u=mistral | changed: [172.16.0.28] >2018-08-30 12:08:55,050 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:08:55,050 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.396) 0:06:41.230 ******* >2018-08-30 12:08:55,116 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:55,130 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:08:55,130 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.079) 0:06:41.310 ******* >2018-08-30 12:08:55,159 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,173 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:08:55,173 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.043) 0:06:41.353 ******* >2018-08-30 12:08:55,207 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,225 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:08:55,225 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.051) 0:06:41.405 ******* >2018-08-30 12:08:55,255 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,270 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:08:55,270 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.045) 0:06:41.451 ******* >2018-08-30 12:08:55,298 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,312 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:08:55,312 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.041) 0:06:41.492 ******* >2018-08-30 12:08:55,343 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,359 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:08:55,360 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.047) 0:06:41.540 ******* >2018-08-30 12:08:55,393 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,413 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:08:55,413 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.053) 0:06:41.593 ******* >2018-08-30 12:08:55,443 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,464 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:08:55,464 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.050) 0:06:41.644 ******* >2018-08-30 12:08:55,490 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,505 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:08:55,505 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.041) 0:06:41.686 ******* >2018-08-30 12:08:55,534 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,546 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:08:55,546 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.040) 0:06:41.726 ******* >2018-08-30 12:08:55,577 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,596 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:08:55,597 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.050) 0:06:41.777 ******* >2018-08-30 12:08:55,628 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:55,641 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:08:55,641 p=7972 u=mistral | Thursday 30 August 2018 12:08:55 -0400 (0:00:00.044) 0:06:41.822 ******* >2018-08-30 12:08:56,721 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:56,734 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:08:56,734 p=7972 u=mistral | Thursday 30 August 2018 12:08:56 -0400 (0:00:01.092) 0:06:42.914 ******* >2018-08-30 12:08:56,798 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:56,812 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:08:56,812 p=7972 u=mistral | Thursday 30 August 2018 12:08:56 -0400 (0:00:00.077) 0:06:42.992 ******* >2018-08-30 12:08:56,843 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:56,856 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:08:56,856 p=7972 u=mistral | Thursday 30 August 2018 12:08:56 -0400 (0:00:00.044) 0:06:43.036 ******* >2018-08-30 12:08:56,885 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:56,897 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:08:56,898 p=7972 u=mistral | Thursday 30 August 2018 12:08:56 -0400 (0:00:00.041) 0:06:43.078 ******* >2018-08-30 12:08:56,957 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:08:56,970 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:08:56,970 p=7972 u=mistral | Thursday 30 August 2018 12:08:56 -0400 (0:00:00.072) 0:06:43.150 ******* >2018-08-30 12:08:57,000 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:57,013 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:08:57,013 p=7972 u=mistral | Thursday 30 August 2018 12:08:57 -0400 (0:00:00.043) 0:06:43.193 ******* >2018-08-30 12:08:57,044 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:57,060 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:08:57,060 p=7972 u=mistral | Thursday 30 August 2018 12:08:57 -0400 (0:00:00.047) 0:06:43.240 ******* >2018-08-30 12:08:57,388 p=7972 u=mistral | changed: [172.16.0.28] => (item=/etc/ceph) >2018-08-30 12:08:57,830 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:08:58,118 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:08:58,426 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:08:58,717 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:08:58,735 p=7972 u=mistral | TASK [ceph-osd : make sure public_network configured] ************************** >2018-08-30 12:08:58,735 p=7972 u=mistral | Thursday 30 August 2018 12:08:58 -0400 (0:00:01.674) 0:06:44.915 ******* >2018-08-30 12:08:58,766 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:58,780 p=7972 u=mistral | TASK [ceph-osd : make sure cluster_network configured] ************************* >2018-08-30 12:08:58,781 p=7972 u=mistral | Thursday 30 August 2018 12:08:58 -0400 (0:00:00.045) 0:06:44.961 ******* >2018-08-30 12:08:58,815 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:58,833 p=7972 u=mistral | TASK [ceph-osd : make sure journal_size configured] **************************** >2018-08-30 12:08:58,834 p=7972 u=mistral | Thursday 30 August 2018 12:08:58 -0400 (0:00:00.053) 0:06:45.014 ******* >2018-08-30 12:08:58,866 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:58,882 p=7972 u=mistral | TASK [ceph-osd : make sure an osd scenario was chosen] ************************* >2018-08-30 12:08:58,883 p=7972 u=mistral | Thursday 30 August 2018 12:08:58 -0400 (0:00:00.048) 0:06:45.063 ******* >2018-08-30 12:08:58,919 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:58,936 p=7972 u=mistral | TASK [ceph-osd : make sure a valid osd scenario was chosen] ******************** >2018-08-30 12:08:58,937 p=7972 u=mistral | Thursday 30 August 2018 12:08:58 -0400 (0:00:00.054) 0:06:45.117 ******* >2018-08-30 12:08:58,974 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:58,987 p=7972 u=mistral | TASK [ceph-osd : verify devices have been provided] **************************** >2018-08-30 12:08:58,987 p=7972 u=mistral | Thursday 30 August 2018 12:08:58 -0400 (0:00:00.050) 0:06:45.168 ******* >2018-08-30 12:08:59,030 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,044 p=7972 u=mistral | TASK [ceph-osd : check if osd_scenario lvm is supported by the selected ceph version] *** >2018-08-30 12:08:59,044 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.056) 0:06:45.224 ******* >2018-08-30 12:08:59,074 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,087 p=7972 u=mistral | TASK [ceph-osd : verify lvm_volumes have been provided] ************************ >2018-08-30 12:08:59,087 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.043) 0:06:45.268 ******* >2018-08-30 12:08:59,120 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,133 p=7972 u=mistral | TASK [ceph-osd : make sure the lvm_volumes variable is a list] ***************** >2018-08-30 12:08:59,133 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.045) 0:06:45.313 ******* >2018-08-30 12:08:59,168 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,182 p=7972 u=mistral | TASK [ceph-osd : make sure the devices variable is a list] ********************* >2018-08-30 12:08:59,182 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.049) 0:06:45.362 ******* >2018-08-30 12:08:59,217 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,232 p=7972 u=mistral | TASK [ceph-osd : verify dedicated devices have been provided] ****************** >2018-08-30 12:08:59,232 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.049) 0:06:45.412 ******* >2018-08-30 12:08:59,269 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,282 p=7972 u=mistral | TASK [ceph-osd : make sure the dedicated_devices variable is a list] *********** >2018-08-30 12:08:59,283 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.050) 0:06:45.463 ******* >2018-08-30 12:08:59,321 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,336 p=7972 u=mistral | TASK [ceph-osd : check if bluestore is supported by the selected ceph version] *** >2018-08-30 12:08:59,337 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.053) 0:06:45.517 ******* >2018-08-30 12:08:59,378 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,392 p=7972 u=mistral | TASK [ceph-osd : include system_tuning.yml] ************************************ >2018-08-30 12:08:59,392 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.055) 0:06:45.572 ******* >2018-08-30 12:08:59,489 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/system_tuning.yml for 172.16.0.28 >2018-08-30 12:08:59,525 p=7972 u=mistral | TASK [ceph-osd : disable osd directory parsing by updatedb] ******************** >2018-08-30 12:08:59,525 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.132) 0:06:45.705 ******* >2018-08-30 12:08:59,557 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,571 p=7972 u=mistral | TASK [ceph-osd : disable osd directory path in updatedb.conf] ****************** >2018-08-30 12:08:59,571 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.046) 0:06:45.752 ******* >2018-08-30 12:08:59,607 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:08:59,620 p=7972 u=mistral | TASK [ceph-osd : create tmpfiles.d directory] ********************************** >2018-08-30 12:08:59,620 p=7972 u=mistral | Thursday 30 August 2018 12:08:59 -0400 (0:00:00.048) 0:06:45.800 ******* >2018-08-30 12:09:00,135 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:00,148 p=7972 u=mistral | TASK [ceph-osd : disable transparent hugepage] ********************************* >2018-08-30 12:09:00,149 p=7972 u=mistral | Thursday 30 August 2018 12:09:00 -0400 (0:00:00.528) 0:06:46.329 ******* >2018-08-30 12:09:01,196 p=7972 u=mistral | changed: [172.16.0.28] >2018-08-30 12:09:01,209 p=7972 u=mistral | TASK [ceph-osd : get default vm.min_free_kbytes] ******************************* >2018-08-30 12:09:01,209 p=7972 u=mistral | Thursday 30 August 2018 12:09:01 -0400 (0:00:01.060) 0:06:47.389 ******* >2018-08-30 12:09:01,698 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:01,713 p=7972 u=mistral | TASK [ceph-osd : set_fact vm_min_free_kbytes] ********************************** >2018-08-30 12:09:01,713 p=7972 u=mistral | Thursday 30 August 2018 12:09:01 -0400 (0:00:00.504) 0:06:47.894 ******* >2018-08-30 12:09:01,937 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:01,949 p=7972 u=mistral | TASK [ceph-osd : apply operating system tuning] ******************************** >2018-08-30 12:09:01,950 p=7972 u=mistral | Thursday 30 August 2018 12:09:01 -0400 (0:00:00.236) 0:06:48.130 ******* >2018-08-30 12:09:02,598 p=7972 u=mistral | changed: [172.16.0.28] => (item={u'enable': u"(osd_objectstore == 'bluestore')", u'name': u'fs.aio-max-nr', u'value': u'1048576'}) >2018-08-30 12:09:02,908 p=7972 u=mistral | changed: [172.16.0.28] => (item={u'name': u'fs.file-max', u'value': 26234859}) >2018-08-30 12:09:03,203 p=7972 u=mistral | changed: [172.16.0.28] => (item={u'name': u'vm.zone_reclaim_mode', u'value': 0}) >2018-08-30 12:09:03,495 p=7972 u=mistral | changed: [172.16.0.28] => (item={u'name': u'vm.swappiness', u'value': 10}) >2018-08-30 12:09:03,788 p=7972 u=mistral | changed: [172.16.0.28] => (item={u'name': u'vm.min_free_kbytes', u'value': u'67584'}) >2018-08-30 12:09:03,802 p=7972 u=mistral | TASK [ceph-osd : install dependencies] ***************************************** >2018-08-30 12:09:03,802 p=7972 u=mistral | Thursday 30 August 2018 12:09:03 -0400 (0:00:01.852) 0:06:49.982 ******* >2018-08-30 12:09:03,828 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:03,839 p=7972 u=mistral | TASK [ceph-osd : include common.yml] ******************************************* >2018-08-30 12:09:03,839 p=7972 u=mistral | Thursday 30 August 2018 12:09:03 -0400 (0:00:00.037) 0:06:50.020 ******* >2018-08-30 12:09:03,884 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/common.yml for 172.16.0.28 >2018-08-30 12:09:03,939 p=7972 u=mistral | TASK [ceph-osd : create bootstrap-osd and osd directories] ********************* >2018-08-30 12:09:03,940 p=7972 u=mistral | Thursday 30 August 2018 12:09:03 -0400 (0:00:00.100) 0:06:50.120 ******* >2018-08-30 12:09:04,490 p=7972 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-osd/) >2018-08-30 12:09:04,730 p=7972 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/osd/) >2018-08-30 12:09:04,753 p=7972 u=mistral | TASK [ceph-osd : copy ceph key(s) if needed] *********************************** >2018-08-30 12:09:04,753 p=7972 u=mistral | Thursday 30 August 2018 12:09:04 -0400 (0:00:00.813) 0:06:50.933 ******* >2018-08-30 12:09:05,492 p=7972 u=mistral | changed: [172.16.0.28] => (item={u'name': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'copy_key': True}) >2018-08-30 12:09:05,500 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:09:05,518 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore'] *** >2018-08-30 12:09:05,518 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.764) 0:06:51.698 ******* >2018-08-30 12:09:05,552 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:05,566 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options 'ceph_disk_cli_options'] ******* >2018-08-30 12:09:05,566 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.047) 0:06:51.746 ******* >2018-08-30 12:09:05,612 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:05,633 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph'] ************** >2018-08-30 12:09:05,633 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.067) 0:06:51.814 ******* >2018-08-30 12:09:05,677 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:05,693 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore --dmcrypt'] *** >2018-08-30 12:09:05,693 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.059) 0:06:51.873 ******* >2018-08-30 12:09:05,724 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:05,739 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --filestore --dmcrypt'] *** >2018-08-30 12:09:05,739 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.046) 0:06:51.919 ******* >2018-08-30 12:09:05,774 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:05,790 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --dmcrypt'] **** >2018-08-30 12:09:05,790 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.050) 0:06:51.970 ******* >2018-08-30 12:09:05,826 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:05,843 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e KV_TYPE=etcd -e KV_IP=127.0.0.1 -e KV_PORT=2379'] *** >2018-08-30 12:09:05,844 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.053) 0:06:52.024 ******* >2018-08-30 12:09:05,871 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:05,885 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:09:05,886 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.042) 0:06:52.066 ******* >2018-08-30 12:09:05,955 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:05,969 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:09:05,969 p=7972 u=mistral | Thursday 30 August 2018 12:09:05 -0400 (0:00:00.083) 0:06:52.149 ******* >2018-08-30 12:09:06,000 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:06,013 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:09:06,013 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.044) 0:06:52.193 ******* >2018-08-30 12:09:06,052 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:06,068 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:09:06,068 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.055) 0:06:52.248 ******* >2018-08-30 12:09:06,101 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:06,116 p=7972 u=mistral | TASK [ceph-osd : set_fact devices generate device list when osd_auto_discovery] *** >2018-08-30 12:09:06,117 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.048) 0:06:52.297 ******* >2018-08-30 12:09:06,163 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vda1': {u'sectorsize': 512, u'uuid': u'2018-08-02-20-03-08-00', u'links': {u'masters': [], u'labels': [u'config-2'], u'ids': [], u'uuids': [u'2018-08-02-20-03-08-00']}, u'sectors': u'2048', u'start': u'2048', u'holders': [], u'size': u'1.00 MB'}, u'vda2': {u'sectorsize': 512, u'uuid': u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2', u'links': {u'masters': [], u'labels': [u'img-rootfs'], u'ids': [], u'uuids': [u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2']}, u'sectors': u'209711071', u'start': u'4096', u'holders': [], u'size': u'100.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vda'}) >2018-08-30 12:09:06,169 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vdb1': {u'sectorsize': 512, u'uuid': u'c9d8ebb9-7706-48e7-b732-4218bfe9ca0a', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': [u'c9d8ebb9-7706-48e7-b732-4218bfe9ca0a']}, u'sectors': u'199227359', u'start': u'10487808', u'holders': [], u'size': u'95.00 GB'}, u'vdb2': {u'sectorsize': 512, u'uuid': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'10485760', u'start': u'2048', u'holders': [], u'size': u'5.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vdb'}) >2018-08-30 12:09:06,192 p=7972 u=mistral | TASK [ceph-osd : resolve dedicated device link(s)] ***************************** >2018-08-30 12:09:06,192 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.075) 0:06:52.372 ******* >2018-08-30 12:09:06,242 p=7972 u=mistral | TASK [ceph-osd : set_fact build dedicated_devices from resolved symlinks] ****** >2018-08-30 12:09:06,243 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.050) 0:06:52.423 ******* >2018-08-30 12:09:06,290 p=7972 u=mistral | TASK [ceph-osd : set_fact build final dedicated_devices list] ****************** >2018-08-30 12:09:06,291 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.047) 0:06:52.471 ******* >2018-08-30 12:09:06,324 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:06,341 p=7972 u=mistral | TASK [ceph-osd : read information about the devices] *************************** >2018-08-30 12:09:06,341 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.050) 0:06:52.521 ******* >2018-08-30 12:09:06,891 p=7972 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:09:06,911 p=7972 u=mistral | TASK [ceph-osd : check the partition status of the osd disks] ****************** >2018-08-30 12:09:06,911 p=7972 u=mistral | Thursday 30 August 2018 12:09:06 -0400 (0:00:00.570) 0:06:53.092 ******* >2018-08-30 12:09:07,247 p=7972 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:09:07,266 p=7972 u=mistral | TASK [ceph-osd : create gpt disk label] **************************************** >2018-08-30 12:09:07,266 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.354) 0:06:53.447 ******* >2018-08-30 12:09:07,318 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'blkid', u'-t', u'PTTYPE=gpt', u'/dev/vdb'], u'end': u'2018-08-30 12:09:08.198186', '_ansible_no_log': False, u'stdout': u'/dev/vdb: PTTYPE="gpt" ', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.011152', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'blkid -t PTTYPE="gpt" /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb: PTTYPE="gpt" '], 'failed_when_result': False, u'start': u'2018-08-30 12:09:08.187034', '_ansible_ignore_errors': None, 'failed': False}, u'/dev/vdb']) >2018-08-30 12:09:07,337 p=7972 u=mistral | TASK [ceph-osd : include scenarios/collocated.yml] ***************************** >2018-08-30 12:09:07,337 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.070) 0:06:53.517 ******* >2018-08-30 12:09:07,400 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/scenarios/collocated.yml for 172.16.0.28 >2018-08-30 12:09:07,455 p=7972 u=mistral | TASK [ceph-osd : prepare ceph containerized osd disk collocated] *************** >2018-08-30 12:09:07,456 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.118) 0:06:53.636 ******* >2018-08-30 12:09:07,502 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:09:07,518 p=7972 u=mistral | TASK [ceph-osd : automatic prepare ceph containerized osd disk collocated] ***** >2018-08-30 12:09:07,519 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.063) 0:06:53.699 ******* >2018-08-30 12:09:07,556 p=7972 u=mistral | skipping: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:09:07,576 p=7972 u=mistral | TASK [ceph-osd : manually prepare ceph "filestore" non-containerized osd disk(s) with collocated osd data and journal] *** >2018-08-30 12:09:07,576 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.057) 0:06:53.756 ******* >2018-08-30 12:09:07,621 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:09:07,636 p=7972 u=mistral | TASK [ceph-osd : include scenarios/non-collocated.yml] ************************* >2018-08-30 12:09:07,637 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.060) 0:06:53.817 ******* >2018-08-30 12:09:07,669 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:07,680 p=7972 u=mistral | TASK [ceph-osd : include scenarios/lvm.yml] ************************************ >2018-08-30 12:09:07,681 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.043) 0:06:53.861 ******* >2018-08-30 12:09:07,710 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:07,723 p=7972 u=mistral | TASK [ceph-osd : include activate_osds.yml] ************************************ >2018-08-30 12:09:07,723 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.042) 0:06:53.903 ******* >2018-08-30 12:09:07,755 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:07,768 p=7972 u=mistral | TASK [ceph-osd : include start_osds.yml] *************************************** >2018-08-30 12:09:07,769 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.045) 0:06:53.949 ******* >2018-08-30 12:09:07,795 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:07,809 p=7972 u=mistral | TASK [ceph-osd : include docker/main.yml] ************************************** >2018-08-30 12:09:07,809 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.040) 0:06:53.989 ******* >2018-08-30 12:09:07,851 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/main.yml for 172.16.0.28 >2018-08-30 12:09:07,919 p=7972 u=mistral | TASK [ceph-osd : include start_docker_osd.yml] ********************************* >2018-08-30 12:09:07,919 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.110) 0:06:54.100 ******* >2018-08-30 12:09:07,964 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/start_docker_osd.yml for 172.16.0.28 >2018-08-30 12:09:07,977 p=7972 u=mistral | TASK [ceph-osd : umount ceph disk (if on openstack)] *************************** >2018-08-30 12:09:07,978 p=7972 u=mistral | Thursday 30 August 2018 12:09:07 -0400 (0:00:00.058) 0:06:54.158 ******* >2018-08-30 12:09:08,002 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:08,014 p=7972 u=mistral | TASK [ceph-osd : test if the container image has the disk_list function] ******* >2018-08-30 12:09:08,015 p=7972 u=mistral | Thursday 30 August 2018 12:09:08 -0400 (0:00:00.036) 0:06:54.195 ******* >2018-08-30 12:09:08,764 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:08,779 p=7972 u=mistral | TASK [ceph-osd : generate ceph osd docker run script] ************************** >2018-08-30 12:09:08,780 p=7972 u=mistral | Thursday 30 August 2018 12:09:08 -0400 (0:00:00.765) 0:06:54.960 ******* >2018-08-30 12:09:10,036 p=7972 u=mistral | changed: [172.16.0.28] >2018-08-30 12:09:10,047 p=7972 u=mistral | TASK [ceph-osd : generate systemd unit file] *********************************** >2018-08-30 12:09:10,048 p=7972 u=mistral | Thursday 30 August 2018 12:09:10 -0400 (0:00:01.267) 0:06:56.228 ******* >2018-08-30 12:09:11,309 p=7972 u=mistral | changed: [172.16.0.28] >2018-08-30 12:09:11,321 p=7972 u=mistral | TASK [ceph-osd : systemd start osd container] ********************************** >2018-08-30 12:09:11,321 p=7972 u=mistral | Thursday 30 August 2018 12:09:11 -0400 (0:00:01.273) 0:06:57.501 ******* >2018-08-30 12:09:12,026 p=7972 u=mistral | changed: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:09:12,051 p=7972 u=mistral | TASK [ceph-osd : set_fact openstack_keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:09:12,052 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.730) 0:06:58.232 ******* >2018-08-30 12:09:12,144 p=7972 u=mistral | ok: [172.16.0.28] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:09:12,175 p=7972 u=mistral | ok: [172.16.0.28] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:09:12,205 p=7972 u=mistral | ok: [172.16.0.28] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:09:12,220 p=7972 u=mistral | TASK [ceph-osd : set_fact keys - override keys_tmp with keys] ****************** >2018-08-30 12:09:12,221 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.169) 0:06:58.401 ******* >2018-08-30 12:09:12,279 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:12,310 p=7972 u=mistral | TASK [ceph-osd : wait for all osd to be up] ************************************ >2018-08-30 12:09:12,310 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.089) 0:06:58.490 ******* >2018-08-30 12:09:12,344 p=7972 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:09:12,384 p=7972 u=mistral | TASK [ceph-osd : list existing pool(s)] **************************************** >2018-08-30 12:09:12,384 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.074) 0:06:58.564 ******* >2018-08-30 12:09:12,425 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,435 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,447 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,458 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,470 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,516 p=7972 u=mistral | TASK [ceph-osd : create openstack pool(s)] ************************************* >2018-08-30 12:09:12,516 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.132) 0:06:58.697 ******* >2018-08-30 12:09:12,566 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:09:12,577 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:09:12,591 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:09:12,604 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:09:12,617 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:09:12,667 p=7972 u=mistral | TASK [ceph-osd : assign application to pool(s)] ******************************** >2018-08-30 12:09:12,668 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.151) 0:06:58.848 ******* >2018-08-30 12:09:12,714 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,726 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,738 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,749 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,762 p=7972 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:09:12,799 p=7972 u=mistral | TASK [ceph-osd : create openstack cephx key(s)] ******************************** >2018-08-30 12:09:12,800 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.131) 0:06:58.980 ******* >2018-08-30 12:09:12,844 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:09:12,856 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:09:12,870 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:09:12,922 p=7972 u=mistral | TASK [ceph-osd : fetch openstack cephx key(s)] ********************************* >2018-08-30 12:09:12,923 p=7972 u=mistral | Thursday 30 August 2018 12:09:12 -0400 (0:00:00.123) 0:06:59.103 ******* >2018-08-30 12:09:12,976 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:09:12,987 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:09:13,000 p=7972 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:09:13,069 p=7972 u=mistral | TASK [ceph-osd : copy to other mons the openstack cephx key(s)] **************** >2018-08-30 12:09:13,070 p=7972 u=mistral | Thursday 30 August 2018 12:09:13 -0400 (0:00:00.147) 0:06:59.250 ******* >2018-08-30 12:09:13,118 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.33', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:09:13,131 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.33', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:09:13,142 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.33', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:09:13,155 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.24', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:09:13,169 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.24', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:09:13,181 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.24', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:09:13,191 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.25', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:09:13,204 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.25', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:09:13,216 p=7972 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.25', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:09:13,220 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:09:13,221 p=7972 u=mistral | Thursday 30 August 2018 12:09:13 -0400 (0:00:00.150) 0:06:59.401 ******* >2018-08-30 12:09:13,297 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:13,298 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:09:13,299 p=7972 u=mistral | Thursday 30 August 2018 12:09:13 -0400 (0:00:00.077) 0:06:59.479 ******* >2018-08-30 12:09:14,123 p=7972 u=mistral | changed: [172.16.0.28] >2018-08-30 12:09:14,124 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:09:14,124 p=7972 u=mistral | Thursday 30 August 2018 12:09:14 -0400 (0:00:00.824) 0:07:00.304 ******* >2018-08-30 12:09:14,217 p=7972 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:09:14,231 p=7972 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.36) >2018-08-30 12:09:14,245 p=7972 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.32) >2018-08-30 12:09:14,247 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:09:14,247 p=7972 u=mistral | Thursday 30 August 2018 12:09:14 -0400 (0:00:00.123) 0:07:00.428 ******* >2018-08-30 12:09:14,343 p=7972 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:09:14,362 p=7972 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.36) >2018-08-30 12:09:14,379 p=7972 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.32) >2018-08-30 12:09:14,382 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:09:14,382 p=7972 u=mistral | Thursday 30 August 2018 12:09:14 -0400 (0:00:00.134) 0:07:00.562 ******* >2018-08-30 12:09:14,454 p=7972 u=mistral | ok: [172.16.0.28] >2018-08-30 12:09:14,484 p=7972 u=mistral | TASK [get num_pgs] ************************************************************* >2018-08-30 12:09:14,485 p=7972 u=mistral | Thursday 30 August 2018 12:09:14 -0400 (0:00:00.102) 0:07:00.665 ******* >2018-08-30 12:09:15,649 p=7972 u=mistral | changed: [172.16.0.28 -> 172.16.0.33] >2018-08-30 12:09:15,675 p=7972 u=mistral | TASK [container - waiting for clean pgs...] ************************************ >2018-08-30 12:09:15,676 p=7972 u=mistral | Thursday 30 August 2018 12:09:15 -0400 (0:00:01.190) 0:07:01.856 ******* >2018-08-30 12:09:16,520 p=7972 u=mistral | FAILED - RETRYING: container - waiting for clean pgs... (5 retries left). >2018-08-30 12:09:32,308 p=7972 u=mistral | changed: [172.16.0.28 -> 172.16.0.33] >2018-08-30 12:09:32,323 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph osd] ************** >2018-08-30 12:09:32,422 p=7972 u=mistral | TASK [collect running osds and ceph-disk unit(s)] ****************************** >2018-08-30 12:09:32,423 p=7972 u=mistral | Thursday 30 August 2018 12:09:32 -0400 (0:00:16.746) 0:07:18.603 ******* >2018-08-30 12:09:33,023 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:33,036 p=7972 u=mistral | TASK [collect osd devices] ***************************************************** >2018-08-30 12:09:33,036 p=7972 u=mistral | Thursday 30 August 2018 12:09:33 -0400 (0:00:00.613) 0:07:19.216 ******* >2018-08-30 12:09:33,062 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:33,073 p=7972 u=mistral | TASK [set devices] ************************************************************* >2018-08-30 12:09:33,073 p=7972 u=mistral | Thursday 30 August 2018 12:09:33 -0400 (0:00:00.036) 0:07:19.253 ******* >2018-08-30 12:09:33,103 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:33,115 p=7972 u=mistral | TASK [stop/disable/mask non-containerized ceph osd(s) and ceph-disk units (if any)] *** >2018-08-30 12:09:33,115 p=7972 u=mistral | Thursday 30 August 2018 12:09:33 -0400 (0:00:00.042) 0:07:19.295 ******* >2018-08-30 12:09:36,798 p=7972 u=mistral | changed: [172.16.0.36] => (item=ceph-osd@1.service) >2018-08-30 12:09:36,814 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:09:36,815 p=7972 u=mistral | Thursday 30 August 2018 12:09:36 -0400 (0:00:03.699) 0:07:22.995 ******* >2018-08-30 12:09:36,841 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:36,853 p=7972 u=mistral | TASK [set_fact ceph_uid for red hat] ******************************************* >2018-08-30 12:09:36,854 p=7972 u=mistral | Thursday 30 August 2018 12:09:36 -0400 (0:00:00.038) 0:07:23.034 ******* >2018-08-30 12:09:36,881 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:36,895 p=7972 u=mistral | TASK [set_fact ceph_uid for rhel] ********************************************** >2018-08-30 12:09:36,896 p=7972 u=mistral | Thursday 30 August 2018 12:09:36 -0400 (0:00:00.041) 0:07:23.076 ******* >2018-08-30 12:09:37,133 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:37,147 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:09:37,147 p=7972 u=mistral | Thursday 30 August 2018 12:09:37 -0400 (0:00:00.251) 0:07:23.327 ******* >2018-08-30 12:09:39,094 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph) >2018-08-30 12:09:39,432 p=7972 u=mistral | changed: [172.16.0.36] => (item=/etc/ceph) >2018-08-30 12:09:39,446 p=7972 u=mistral | TASK [check for existing old leveldb file extension (ldb)] ********************* >2018-08-30 12:09:39,446 p=7972 u=mistral | Thursday 30 August 2018 12:09:39 -0400 (0:00:02.299) 0:07:25.627 ******* >2018-08-30 12:09:39,946 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:39,960 p=7972 u=mistral | TASK [rename leveldb extension from ldb to sst] ******************************** >2018-08-30 12:09:39,960 p=7972 u=mistral | Thursday 30 August 2018 12:09:39 -0400 (0:00:00.513) 0:07:26.140 ******* >2018-08-30 12:09:39,986 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:39,998 p=7972 u=mistral | TASK [check if containerized osds are already running] ************************* >2018-08-30 12:09:39,999 p=7972 u=mistral | Thursday 30 August 2018 12:09:39 -0400 (0:00:00.038) 0:07:26.179 ******* >2018-08-30 12:09:40,564 p=7972 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:09:40,577 p=7972 u=mistral | TASK [resolve device(s) path(s)] *********************************************** >2018-08-30 12:09:40,577 p=7972 u=mistral | Thursday 30 August 2018 12:09:40 -0400 (0:00:00.578) 0:07:26.757 ******* >2018-08-30 12:09:40,878 p=7972 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:09:40,892 p=7972 u=mistral | TASK [unmount all the osd directories] ***************************************** >2018-08-30 12:09:40,892 p=7972 u=mistral | Thursday 30 August 2018 12:09:40 -0400 (0:00:00.314) 0:07:27.072 ******* >2018-08-30 12:09:41,271 p=7972 u=mistral | ok: [172.16.0.36] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'end': u'2018-08-30 12:09:41.829085', '_ansible_no_log': False, u'stdout': u'/dev/vdb', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.005599', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:09:41.823486', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'docker ps | grep -sq devvdb', u'end': u'2018-08-30 12:09:41.516498', '_ansible_no_log': False, u'stdout': u'', '_ansible_item_result': True, u'changed': False, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u'docker ps | grep -sq devvdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2018-08-30 12:09:41.466422', u'delta': u'0:00:00.050076', 'item': u'/dev/vdb', u'rc': 1, u'msg': u'non-zero return code', 'stdout_lines': [], 'failed_when_result': False, u'stderr': u'', '_ansible_ignore_errors': None, u'failed': False}]) >2018-08-30 12:09:41,294 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:09:41,295 p=7972 u=mistral | Thursday 30 August 2018 12:09:41 -0400 (0:00:00.402) 0:07:27.475 ******* >2018-08-30 12:09:41,328 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:41,343 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:09:41,343 p=7972 u=mistral | Thursday 30 August 2018 12:09:41 -0400 (0:00:00.048) 0:07:27.523 ******* >2018-08-30 12:09:41,881 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:41,894 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:09:41,894 p=7972 u=mistral | Thursday 30 August 2018 12:09:41 -0400 (0:00:00.551) 0:07:28.074 ******* >2018-08-30 12:09:41,923 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:41,935 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:09:41,935 p=7972 u=mistral | Thursday 30 August 2018 12:09:41 -0400 (0:00:00.040) 0:07:28.115 ******* >2018-08-30 12:09:41,963 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:41,975 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:09:41,976 p=7972 u=mistral | Thursday 30 August 2018 12:09:41 -0400 (0:00:00.040) 0:07:28.156 ******* >2018-08-30 12:09:42,004 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,017 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:09:42,017 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.041) 0:07:28.197 ******* >2018-08-30 12:09:42,045 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,058 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:09:42,059 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.041) 0:07:28.239 ******* >2018-08-30 12:09:42,086 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,100 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:09:42,100 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.041) 0:07:28.281 ******* >2018-08-30 12:09:42,127 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,141 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:09:42,142 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.041) 0:07:28.322 ******* >2018-08-30 12:09:42,169 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,182 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:09:42,183 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.041) 0:07:28.363 ******* >2018-08-30 12:09:42,210 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,225 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:09:42,225 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.042) 0:07:28.405 ******* >2018-08-30 12:09:42,251 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,263 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:09:42,264 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.038) 0:07:28.444 ******* >2018-08-30 12:09:42,288 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,302 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:09:42,302 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.038) 0:07:28.482 ******* >2018-08-30 12:09:42,331 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,344 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:09:42,344 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.042) 0:07:28.525 ******* >2018-08-30 12:09:42,377 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,391 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:09:42,391 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.046) 0:07:28.571 ******* >2018-08-30 12:09:42,424 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,438 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:09:42,438 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.046) 0:07:28.618 ******* >2018-08-30 12:09:42,468 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,480 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:09:42,480 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.042) 0:07:28.661 ******* >2018-08-30 12:09:42,515 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,529 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:09:42,529 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.048) 0:07:28.710 ******* >2018-08-30 12:09:42,568 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,583 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:09:42,583 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.053) 0:07:28.763 ******* >2018-08-30 12:09:42,611 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,632 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:09:42,632 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.049) 0:07:28.813 ******* >2018-08-30 12:09:42,666 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,680 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:09:42,680 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.047) 0:07:28.860 ******* >2018-08-30 12:09:42,712 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,728 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:09:42,728 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.048) 0:07:28.909 ******* >2018-08-30 12:09:42,763 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,779 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:09:42,779 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.050) 0:07:28.959 ******* >2018-08-30 12:09:42,814 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,831 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:09:42,831 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.052) 0:07:29.011 ******* >2018-08-30 12:09:42,867 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,882 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:09:42,883 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.051) 0:07:29.063 ******* >2018-08-30 12:09:42,917 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,932 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:09:42,932 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.049) 0:07:29.112 ******* >2018-08-30 12:09:42,960 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:42,973 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:09:42,973 p=7972 u=mistral | Thursday 30 August 2018 12:09:42 -0400 (0:00:00.040) 0:07:29.153 ******* >2018-08-30 12:09:43,007 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:43,021 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:09:43,021 p=7972 u=mistral | Thursday 30 August 2018 12:09:43 -0400 (0:00:00.048) 0:07:29.201 ******* >2018-08-30 12:09:43,048 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:43,063 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:09:43,064 p=7972 u=mistral | Thursday 30 August 2018 12:09:43 -0400 (0:00:00.042) 0:07:29.244 ******* >2018-08-30 12:09:43,378 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:43,391 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:09:43,391 p=7972 u=mistral | Thursday 30 August 2018 12:09:43 -0400 (0:00:00.327) 0:07:29.572 ******* >2018-08-30 12:09:43,450 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:43,466 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:09:43,466 p=7972 u=mistral | Thursday 30 August 2018 12:09:43 -0400 (0:00:00.074) 0:07:29.646 ******* >2018-08-30 12:09:43,525 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:43,540 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:09:43,540 p=7972 u=mistral | Thursday 30 August 2018 12:09:43 -0400 (0:00:00.073) 0:07:29.720 ******* >2018-08-30 12:09:43,563 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:43,592 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:09:43,592 p=7972 u=mistral | Thursday 30 August 2018 12:09:43 -0400 (0:00:00.051) 0:07:29.772 ******* >2018-08-30 12:09:43,703 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.33] >2018-08-30 12:09:43,732 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:09:43,732 p=7972 u=mistral | Thursday 30 August 2018 12:09:43 -0400 (0:00:00.140) 0:07:29.912 ******* >2018-08-30 12:09:44,797 p=7972 u=mistral | ok: [172.16.0.36 -> 172.16.0.33] >2018-08-30 12:09:44,821 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:09:44,821 p=7972 u=mistral | Thursday 30 August 2018 12:09:44 -0400 (0:00:01.088) 0:07:31.001 ******* >2018-08-30 12:09:45,059 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] >2018-08-30 12:09:45,073 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:09:45,074 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.252) 0:07:31.254 ******* >2018-08-30 12:09:45,100 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:45,118 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:09:45,118 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.043) 0:07:31.298 ******* >2018-08-30 12:09:45,359 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] >2018-08-30 12:09:45,372 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:09:45,373 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.254) 0:07:31.553 ******* >2018-08-30 12:09:45,439 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:45,458 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:09:45,458 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.085) 0:07:31.638 ******* >2018-08-30 12:09:45,523 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:45,544 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:09:45,544 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.085) 0:07:31.724 ******* >2018-08-30 12:09:45,574 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:45,591 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:09:45,591 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.046) 0:07:31.771 ******* >2018-08-30 12:09:45,836 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] >2018-08-30 12:09:45,862 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:09:45,863 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.271) 0:07:32.043 ******* >2018-08-30 12:09:45,887 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:45,904 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:09:45,905 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.042) 0:07:32.085 ******* >2018-08-30 12:09:45,931 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:45,944 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:09:45,945 p=7972 u=mistral | Thursday 30 August 2018 12:09:45 -0400 (0:00:00.040) 0:07:32.125 ******* >2018-08-30 12:09:46,013 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:46,027 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:09:46,028 p=7972 u=mistral | Thursday 30 August 2018 12:09:46 -0400 (0:00:00.082) 0:07:32.208 ******* >2018-08-30 12:09:46,056 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:46,069 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:09:46,069 p=7972 u=mistral | Thursday 30 August 2018 12:09:46 -0400 (0:00:00.041) 0:07:32.249 ******* >2018-08-30 12:09:46,342 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:46,359 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:09:46,359 p=7972 u=mistral | Thursday 30 August 2018 12:09:46 -0400 (0:00:00.289) 0:07:32.539 ******* >2018-08-30 12:09:46,612 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:46,625 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:09:46,625 p=7972 u=mistral | Thursday 30 August 2018 12:09:46 -0400 (0:00:00.265) 0:07:32.805 ******* >2018-08-30 12:09:46,904 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:46,920 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:09:46,920 p=7972 u=mistral | Thursday 30 August 2018 12:09:46 -0400 (0:00:00.295) 0:07:33.100 ******* >2018-08-30 12:09:47,435 p=7972 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:09:47,454 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:09:47,454 p=7972 u=mistral | Thursday 30 August 2018 12:09:47 -0400 (0:00:00.533) 0:07:33.634 ******* >2018-08-30 12:09:47,723 p=7972 u=mistral | ok: [172.16.0.36] => (item={'_ansible_parsed': True, 'stderr_lines': [], '_ansible_item_result': True, u'end': u'2018-08-30 12:09:48.384903', '_ansible_no_log': False, u'stdout': u'/dev/vdb', u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'rc': 0, 'item': u'/dev/vdb', u'delta': u'0:00:00.005926', u'stderr': u'', u'changed': False, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:09:48.378977', '_ansible_ignore_errors': None, 'failed': False}) >2018-08-30 12:09:47,748 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:09:47,748 p=7972 u=mistral | Thursday 30 August 2018 12:09:47 -0400 (0:00:00.294) 0:07:33.928 ******* >2018-08-30 12:09:47,831 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:47,851 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:09:47,851 p=7972 u=mistral | Thursday 30 August 2018 12:09:47 -0400 (0:00:00.103) 0:07:34.031 ******* >2018-08-30 12:09:47,881 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:47,895 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:09:47,895 p=7972 u=mistral | Thursday 30 August 2018 12:09:47 -0400 (0:00:00.043) 0:07:34.075 ******* >2018-08-30 12:09:47,925 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:47,939 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:09:47,939 p=7972 u=mistral | Thursday 30 August 2018 12:09:47 -0400 (0:00:00.044) 0:07:34.120 ******* >2018-08-30 12:09:47,971 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:47,984 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:09:47,984 p=7972 u=mistral | Thursday 30 August 2018 12:09:47 -0400 (0:00:00.044) 0:07:34.164 ******* >2018-08-30 12:09:48,015 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:48,027 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:09:48,028 p=7972 u=mistral | Thursday 30 August 2018 12:09:48 -0400 (0:00:00.043) 0:07:34.208 ******* >2018-08-30 12:09:48,091 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:48,104 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:09:48,105 p=7972 u=mistral | Thursday 30 August 2018 12:09:48 -0400 (0:00:00.076) 0:07:34.285 ******* >2018-08-30 12:09:48,166 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:48,179 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:09:48,179 p=7972 u=mistral | Thursday 30 August 2018 12:09:48 -0400 (0:00:00.074) 0:07:34.359 ******* >2018-08-30 12:09:48,548 p=7972 u=mistral | changed: [172.16.0.36] => (item=/etc/ceph) >2018-08-30 12:09:48,856 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/) >2018-08-30 12:09:49,338 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/mon) >2018-08-30 12:09:49,669 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/osd) >2018-08-30 12:09:50,006 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/mds) >2018-08-30 12:09:50,339 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/tmp) >2018-08-30 12:09:50,638 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:09:50,941 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:09:51,231 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:09:51,540 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:09:51,848 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:09:52,150 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/run/ceph) >2018-08-30 12:09:52,169 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:09:52,169 p=7972 u=mistral | Thursday 30 August 2018 12:09:52 -0400 (0:00:03.989) 0:07:38.349 ******* >2018-08-30 12:09:52,195 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:52,207 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:09:52,208 p=7972 u=mistral | Thursday 30 August 2018 12:09:52 -0400 (0:00:00.038) 0:07:38.388 ******* >2018-08-30 12:09:52,236 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:52,248 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:09:52,248 p=7972 u=mistral | Thursday 30 August 2018 12:09:52 -0400 (0:00:00.040) 0:07:38.428 ******* >2018-08-30 12:09:52,277 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:52,291 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:09:52,291 p=7972 u=mistral | Thursday 30 August 2018 12:09:52 -0400 (0:00:00.042) 0:07:38.471 ******* >2018-08-30 12:09:52,804 p=7972 u=mistral | changed: [172.16.0.36] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:09:53,100 p=7972 u=mistral | changed: [172.16.0.36] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:09:53,116 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:09:53,117 p=7972 u=mistral | Thursday 30 August 2018 12:09:53 -0400 (0:00:00.825) 0:07:39.297 ******* >2018-08-30 12:09:53,184 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:53,198 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:09:53,198 p=7972 u=mistral | Thursday 30 August 2018 12:09:53 -0400 (0:00:00.081) 0:07:39.378 ******* >2018-08-30 12:09:53,221 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:53,234 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:09:53,234 p=7972 u=mistral | Thursday 30 August 2018 12:09:53 -0400 (0:00:00.036) 0:07:39.415 ******* >2018-08-30 12:09:53,572 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:53,587 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:09:53,588 p=7972 u=mistral | Thursday 30 August 2018 12:09:53 -0400 (0:00:00.353) 0:07:39.768 ******* >2018-08-30 12:09:53,840 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:53,852 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:09:53,853 p=7972 u=mistral | Thursday 30 August 2018 12:09:53 -0400 (0:00:00.265) 0:07:40.033 ******* >2018-08-30 12:09:54,376 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:54,390 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:09:54,390 p=7972 u=mistral | Thursday 30 August 2018 12:09:54 -0400 (0:00:00.537) 0:07:40.570 ******* >2018-08-30 12:09:54,665 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:54,678 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:09:54,678 p=7972 u=mistral | Thursday 30 August 2018 12:09:54 -0400 (0:00:00.288) 0:07:40.858 ******* >2018-08-30 12:09:55,064 p=7972 u=mistral | ok: [172.16.0.36] => (item=172.16.0.33) >2018-08-30 12:09:55,189 p=7972 u=mistral | ok: [172.16.0.36] => (item=172.16.0.24) >2018-08-30 12:09:55,330 p=7972 u=mistral | ok: [172.16.0.36] => (item=172.16.0.25) >2018-08-30 12:09:55,345 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:09:55,345 p=7972 u=mistral | Thursday 30 August 2018 12:09:55 -0400 (0:00:00.666) 0:07:41.525 ******* >2018-08-30 12:09:55,448 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:55,462 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:09:55,463 p=7972 u=mistral | Thursday 30 August 2018 12:09:55 -0400 (0:00:00.117) 0:07:41.643 ******* >2018-08-30 12:09:55,567 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:09:55,589 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:09:55,590 p=7972 u=mistral | Thursday 30 August 2018 12:09:55 -0400 (0:00:00.126) 0:07:41.770 ******* >2018-08-30 12:09:55,900 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:09:56,190 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/etc/ceph/monmap-ceph) >2018-08-30 12:09:56,447 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:09:56,737 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:09:57,019 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:09:57,293 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:09:57,587 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:09:57,880 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller03.keyring) >2018-08-30 12:09:58,200 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller01.keyring) >2018-08-30 12:09:58,505 p=7972 u=mistral | ok: [172.16.0.36 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller02.keyring) >2018-08-30 12:09:58,534 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:09:58,534 p=7972 u=mistral | Thursday 30 August 2018 12:09:58 -0400 (0:00:02.944) 0:07:44.714 ******* >2018-08-30 12:09:58,647 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:58,707 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/etc/ceph/monmap-ceph', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/monmap-ceph', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/monmap-ceph', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:58,772 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:58,832 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:58,898 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:58,975 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:59,037 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:59,097 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/etc/ceph/ceph.mgr.lab-controller03.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645199.971, u'block_size': 4096, u'inode': 50344677, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'xusr': False, u'atime': 1535645224.152, u'md5': u'855b52e842439169d0faee60df11c0de', u'isdir': False, u'ctime': 1535645199.971, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'14c1cb46b68d2b51f1dfa491346254a203cb0ff1', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:59,159 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/etc/ceph/ceph.mgr.lab-controller01.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645200.324, u'block_size': 4096, u'inode': 50344678, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'xusr': False, u'atime': 1535645255.581, u'md5': u'766ce60e91448f0c196c1303c2d6a7c4', u'isdir': False, u'ctime': 1535645200.324, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'42599b981d04addb5046bb792a7d4bd1f767ab8b', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:59,221 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'/etc/ceph/ceph.mgr.lab-controller02.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645200.68, u'block_size': 4096, u'inode': 50344679, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'xusr': False, u'atime': 1535645283.235, u'md5': u'516246c66efdfb30f97b8e6819caa58e', u'isdir': False, u'ctime': 1535645200.68, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'2697a3cfce227670e9c71655817435acb758f3a6', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:09:59,252 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:09:59,253 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.718) 0:07:45.433 ******* >2018-08-30 12:09:59,278 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,298 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:09:59,298 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.045) 0:07:45.478 ******* >2018-08-30 12:09:59,325 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,341 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:09:59,342 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.043) 0:07:45.522 ******* >2018-08-30 12:09:59,383 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,401 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:09:59,401 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.059) 0:07:45.581 ******* >2018-08-30 12:09:59,446 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,460 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:09:59,461 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.059) 0:07:45.641 ******* >2018-08-30 12:09:59,494 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,512 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:09:59,513 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.051) 0:07:45.693 ******* >2018-08-30 12:09:59,546 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,564 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:09:59,565 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.051) 0:07:45.745 ******* >2018-08-30 12:09:59,601 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,616 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:09:59,616 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.051) 0:07:45.797 ******* >2018-08-30 12:09:59,652 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,666 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:09:59,667 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.050) 0:07:45.847 ******* >2018-08-30 12:09:59,699 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,724 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:09:59,724 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.057) 0:07:45.904 ******* >2018-08-30 12:09:59,762 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,776 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:09:59,777 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.052) 0:07:45.957 ******* >2018-08-30 12:09:59,807 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,822 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:09:59,822 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.045) 0:07:46.003 ******* >2018-08-30 12:09:59,852 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,865 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:09:59,866 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.043) 0:07:46.046 ******* >2018-08-30 12:09:59,896 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,910 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:09:59,910 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.044) 0:07:46.090 ******* >2018-08-30 12:09:59,943 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:09:59,955 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:09:59,956 p=7972 u=mistral | Thursday 30 August 2018 12:09:59 -0400 (0:00:00.045) 0:07:46.136 ******* >2018-08-30 12:09:59,987 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,000 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:10:00,000 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.044) 0:07:46.181 ******* >2018-08-30 12:10:00,037 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,054 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:10:00,054 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.053) 0:07:46.234 ******* >2018-08-30 12:10:00,097 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,110 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:10:00,110 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.056) 0:07:46.291 ******* >2018-08-30 12:10:00,142 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,154 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:10:00,155 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.044) 0:07:46.335 ******* >2018-08-30 12:10:00,186 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,198 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:10:00,199 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.043) 0:07:46.379 ******* >2018-08-30 12:10:00,230 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,242 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:10:00,243 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.044) 0:07:46.423 ******* >2018-08-30 12:10:00,271 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,283 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:10:00,284 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.040) 0:07:46.464 ******* >2018-08-30 12:10:00,319 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,334 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:10:00,334 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.050) 0:07:46.514 ******* >2018-08-30 12:10:00,361 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,375 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:10:00,376 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.041) 0:07:46.556 ******* >2018-08-30 12:10:00,411 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,425 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:10:00,425 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.049) 0:07:46.606 ******* >2018-08-30 12:10:00,455 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,469 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:10:00,470 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.044) 0:07:46.650 ******* >2018-08-30 12:10:00,501 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,517 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:10:00,518 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.047) 0:07:46.698 ******* >2018-08-30 12:10:00,547 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,563 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:10:00,563 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.045) 0:07:46.743 ******* >2018-08-30 12:10:00,597 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,616 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:10:00,617 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.053) 0:07:46.797 ******* >2018-08-30 12:10:00,655 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:00,674 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:10:00,675 p=7972 u=mistral | Thursday 30 August 2018 12:10:00 -0400 (0:00:00.058) 0:07:46.855 ******* >2018-08-30 12:10:22,371 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:22,388 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:10:22,388 p=7972 u=mistral | Thursday 30 August 2018 12:10:22 -0400 (0:00:21.713) 0:08:08.568 ******* >2018-08-30 12:10:23,016 p=7972 u=mistral | changed: [172.16.0.36] >2018-08-30 12:10:23,036 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:10:23,036 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.647) 0:08:09.216 ******* >2018-08-30 12:10:23,309 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:23,322 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:10:23,323 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.286) 0:08:09.503 ******* >2018-08-30 12:10:23,350 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,363 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:10:23,364 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.040) 0:08:09.544 ******* >2018-08-30 12:10:23,399 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,414 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:10:23,414 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.050) 0:08:09.594 ******* >2018-08-30 12:10:23,441 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,456 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:10:23,457 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.042) 0:08:09.637 ******* >2018-08-30 12:10:23,484 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,498 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:10:23,498 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.041) 0:08:09.679 ******* >2018-08-30 12:10:23,527 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,540 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:10:23,541 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.042) 0:08:09.721 ******* >2018-08-30 12:10:23,569 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,581 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:10:23,582 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.040) 0:08:09.762 ******* >2018-08-30 12:10:23,612 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,629 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:10:23,629 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.047) 0:08:09.809 ******* >2018-08-30 12:10:23,654 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,668 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:10:23,668 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.039) 0:08:09.848 ******* >2018-08-30 12:10:23,695 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,708 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:10:23,709 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.040) 0:08:09.889 ******* >2018-08-30 12:10:23,735 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,748 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:10:23,748 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.039) 0:08:09.928 ******* >2018-08-30 12:10:23,776 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:23,789 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:10:23,789 p=7972 u=mistral | Thursday 30 August 2018 12:10:23 -0400 (0:00:00.041) 0:08:09.970 ******* >2018-08-30 12:10:24,844 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:24,858 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:10:24,858 p=7972 u=mistral | Thursday 30 August 2018 12:10:24 -0400 (0:00:01.068) 0:08:11.038 ******* >2018-08-30 12:10:25,108 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:25,122 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:10:25,123 p=7972 u=mistral | Thursday 30 August 2018 12:10:25 -0400 (0:00:00.264) 0:08:11.303 ******* >2018-08-30 12:10:25,156 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:25,172 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:10:25,173 p=7972 u=mistral | Thursday 30 August 2018 12:10:25 -0400 (0:00:00.049) 0:08:11.353 ******* >2018-08-30 12:10:25,206 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:25,218 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:10:25,218 p=7972 u=mistral | Thursday 30 August 2018 12:10:25 -0400 (0:00:00.045) 0:08:11.398 ******* >2018-08-30 12:10:25,469 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:25,483 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:10:25,483 p=7972 u=mistral | Thursday 30 August 2018 12:10:25 -0400 (0:00:00.264) 0:08:11.663 ******* >2018-08-30 12:10:25,513 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:25,527 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:10:25,527 p=7972 u=mistral | Thursday 30 August 2018 12:10:25 -0400 (0:00:00.043) 0:08:11.707 ******* >2018-08-30 12:10:25,557 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:25,572 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:10:25,572 p=7972 u=mistral | Thursday 30 August 2018 12:10:25 -0400 (0:00:00.044) 0:08:11.752 ******* >2018-08-30 12:10:26,102 p=7972 u=mistral | changed: [172.16.0.36] => (item=/etc/ceph) >2018-08-30 12:10:26,394 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:10:26,708 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:10:27,049 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:10:27,350 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:10:27,371 p=7972 u=mistral | TASK [ceph-osd : make sure public_network configured] ************************** >2018-08-30 12:10:27,371 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:01.799) 0:08:13.551 ******* >2018-08-30 12:10:27,401 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,416 p=7972 u=mistral | TASK [ceph-osd : make sure cluster_network configured] ************************* >2018-08-30 12:10:27,416 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.045) 0:08:13.596 ******* >2018-08-30 12:10:27,446 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,460 p=7972 u=mistral | TASK [ceph-osd : make sure journal_size configured] **************************** >2018-08-30 12:10:27,460 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.043) 0:08:13.640 ******* >2018-08-30 12:10:27,484 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,499 p=7972 u=mistral | TASK [ceph-osd : make sure an osd scenario was chosen] ************************* >2018-08-30 12:10:27,500 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.039) 0:08:13.680 ******* >2018-08-30 12:10:27,541 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,555 p=7972 u=mistral | TASK [ceph-osd : make sure a valid osd scenario was chosen] ******************** >2018-08-30 12:10:27,555 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.055) 0:08:13.735 ******* >2018-08-30 12:10:27,595 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,610 p=7972 u=mistral | TASK [ceph-osd : verify devices have been provided] **************************** >2018-08-30 12:10:27,610 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.055) 0:08:13.791 ******* >2018-08-30 12:10:27,653 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,666 p=7972 u=mistral | TASK [ceph-osd : check if osd_scenario lvm is supported by the selected ceph version] *** >2018-08-30 12:10:27,667 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.056) 0:08:13.847 ******* >2018-08-30 12:10:27,700 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,716 p=7972 u=mistral | TASK [ceph-osd : verify lvm_volumes have been provided] ************************ >2018-08-30 12:10:27,716 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.049) 0:08:13.896 ******* >2018-08-30 12:10:27,752 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,765 p=7972 u=mistral | TASK [ceph-osd : make sure the lvm_volumes variable is a list] ***************** >2018-08-30 12:10:27,765 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.049) 0:08:13.945 ******* >2018-08-30 12:10:27,805 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,821 p=7972 u=mistral | TASK [ceph-osd : make sure the devices variable is a list] ********************* >2018-08-30 12:10:27,821 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.055) 0:08:14.001 ******* >2018-08-30 12:10:27,862 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,876 p=7972 u=mistral | TASK [ceph-osd : verify dedicated devices have been provided] ****************** >2018-08-30 12:10:27,876 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.054) 0:08:14.056 ******* >2018-08-30 12:10:27,909 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,926 p=7972 u=mistral | TASK [ceph-osd : make sure the dedicated_devices variable is a list] *********** >2018-08-30 12:10:27,926 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.049) 0:08:14.106 ******* >2018-08-30 12:10:27,963 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:27,976 p=7972 u=mistral | TASK [ceph-osd : check if bluestore is supported by the selected ceph version] *** >2018-08-30 12:10:27,976 p=7972 u=mistral | Thursday 30 August 2018 12:10:27 -0400 (0:00:00.050) 0:08:14.157 ******* >2018-08-30 12:10:28,013 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:28,030 p=7972 u=mistral | TASK [ceph-osd : include system_tuning.yml] ************************************ >2018-08-30 12:10:28,030 p=7972 u=mistral | Thursday 30 August 2018 12:10:28 -0400 (0:00:00.053) 0:08:14.211 ******* >2018-08-30 12:10:28,084 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/system_tuning.yml for 172.16.0.36 >2018-08-30 12:10:28,259 p=7972 u=mistral | TASK [ceph-osd : disable osd directory parsing by updatedb] ******************** >2018-08-30 12:10:28,260 p=7972 u=mistral | Thursday 30 August 2018 12:10:28 -0400 (0:00:00.229) 0:08:14.440 ******* >2018-08-30 12:10:28,289 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:28,302 p=7972 u=mistral | TASK [ceph-osd : disable osd directory path in updatedb.conf] ****************** >2018-08-30 12:10:28,302 p=7972 u=mistral | Thursday 30 August 2018 12:10:28 -0400 (0:00:00.042) 0:08:14.482 ******* >2018-08-30 12:10:28,331 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:28,347 p=7972 u=mistral | TASK [ceph-osd : create tmpfiles.d directory] ********************************** >2018-08-30 12:10:28,347 p=7972 u=mistral | Thursday 30 August 2018 12:10:28 -0400 (0:00:00.044) 0:08:14.527 ******* >2018-08-30 12:10:28,696 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:28,709 p=7972 u=mistral | TASK [ceph-osd : disable transparent hugepage] ********************************* >2018-08-30 12:10:28,709 p=7972 u=mistral | Thursday 30 August 2018 12:10:28 -0400 (0:00:00.361) 0:08:14.889 ******* >2018-08-30 12:10:29,560 p=7972 u=mistral | changed: [172.16.0.36] >2018-08-30 12:10:29,573 p=7972 u=mistral | TASK [ceph-osd : get default vm.min_free_kbytes] ******************************* >2018-08-30 12:10:29,574 p=7972 u=mistral | Thursday 30 August 2018 12:10:29 -0400 (0:00:00.864) 0:08:15.754 ******* >2018-08-30 12:10:29,904 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:29,919 p=7972 u=mistral | TASK [ceph-osd : set_fact vm_min_free_kbytes] ********************************** >2018-08-30 12:10:29,919 p=7972 u=mistral | Thursday 30 August 2018 12:10:29 -0400 (0:00:00.345) 0:08:16.099 ******* >2018-08-30 12:10:29,980 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:29,994 p=7972 u=mistral | TASK [ceph-osd : apply operating system tuning] ******************************** >2018-08-30 12:10:29,994 p=7972 u=mistral | Thursday 30 August 2018 12:10:29 -0400 (0:00:00.074) 0:08:16.174 ******* >2018-08-30 12:10:30,376 p=7972 u=mistral | changed: [172.16.0.36] => (item={u'enable': u"(osd_objectstore == 'bluestore')", u'name': u'fs.aio-max-nr', u'value': u'1048576'}) >2018-08-30 12:10:30,704 p=7972 u=mistral | changed: [172.16.0.36] => (item={u'name': u'fs.file-max', u'value': 26234859}) >2018-08-30 12:10:31,033 p=7972 u=mistral | changed: [172.16.0.36] => (item={u'name': u'vm.zone_reclaim_mode', u'value': 0}) >2018-08-30 12:10:31,371 p=7972 u=mistral | changed: [172.16.0.36] => (item={u'name': u'vm.swappiness', u'value': 10}) >2018-08-30 12:10:31,675 p=7972 u=mistral | changed: [172.16.0.36] => (item={u'name': u'vm.min_free_kbytes', u'value': u'67584'}) >2018-08-30 12:10:31,691 p=7972 u=mistral | TASK [ceph-osd : install dependencies] ***************************************** >2018-08-30 12:10:31,691 p=7972 u=mistral | Thursday 30 August 2018 12:10:31 -0400 (0:00:01.697) 0:08:17.871 ******* >2018-08-30 12:10:31,719 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:31,735 p=7972 u=mistral | TASK [ceph-osd : include common.yml] ******************************************* >2018-08-30 12:10:31,736 p=7972 u=mistral | Thursday 30 August 2018 12:10:31 -0400 (0:00:00.044) 0:08:17.916 ******* >2018-08-30 12:10:31,777 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/common.yml for 172.16.0.36 >2018-08-30 12:10:31,819 p=7972 u=mistral | TASK [ceph-osd : create bootstrap-osd and osd directories] ********************* >2018-08-30 12:10:31,820 p=7972 u=mistral | Thursday 30 August 2018 12:10:31 -0400 (0:00:00.084) 0:08:18.000 ******* >2018-08-30 12:10:32,170 p=7972 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-osd/) >2018-08-30 12:10:32,459 p=7972 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/osd/) >2018-08-30 12:10:32,474 p=7972 u=mistral | TASK [ceph-osd : copy ceph key(s) if needed] *********************************** >2018-08-30 12:10:32,474 p=7972 u=mistral | Thursday 30 August 2018 12:10:32 -0400 (0:00:00.654) 0:08:18.654 ******* >2018-08-30 12:10:33,191 p=7972 u=mistral | changed: [172.16.0.36] => (item={u'name': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'copy_key': True}) >2018-08-30 12:10:33,198 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:10:33,214 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore'] *** >2018-08-30 12:10:33,214 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.740) 0:08:19.394 ******* >2018-08-30 12:10:33,244 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,263 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options 'ceph_disk_cli_options'] ******* >2018-08-30 12:10:33,263 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.049) 0:08:19.443 ******* >2018-08-30 12:10:33,307 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,323 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph'] ************** >2018-08-30 12:10:33,323 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.059) 0:08:19.503 ******* >2018-08-30 12:10:33,361 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,377 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore --dmcrypt'] *** >2018-08-30 12:10:33,378 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.054) 0:08:19.558 ******* >2018-08-30 12:10:33,405 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,424 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --filestore --dmcrypt'] *** >2018-08-30 12:10:33,425 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.046) 0:08:19.605 ******* >2018-08-30 12:10:33,455 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,470 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --dmcrypt'] **** >2018-08-30 12:10:33,470 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.045) 0:08:19.651 ******* >2018-08-30 12:10:33,503 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,519 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e KV_TYPE=etcd -e KV_IP=127.0.0.1 -e KV_PORT=2379'] *** >2018-08-30 12:10:33,519 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.048) 0:08:19.699 ******* >2018-08-30 12:10:33,546 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,559 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:10:33,559 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.039) 0:08:19.739 ******* >2018-08-30 12:10:33,629 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:33,642 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:10:33,642 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.083) 0:08:19.822 ******* >2018-08-30 12:10:33,680 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,694 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:10:33,694 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.051) 0:08:19.874 ******* >2018-08-30 12:10:33,727 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,739 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:10:33,739 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.045) 0:08:19.919 ******* >2018-08-30 12:10:33,774 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,786 p=7972 u=mistral | TASK [ceph-osd : set_fact devices generate device list when osd_auto_discovery] *** >2018-08-30 12:10:33,786 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.046) 0:08:19.966 ******* >2018-08-30 12:10:33,831 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vda1': {u'sectorsize': 512, u'uuid': u'2018-08-02-20-03-27-00', u'links': {u'masters': [], u'labels': [u'config-2'], u'ids': [], u'uuids': [u'2018-08-02-20-03-27-00']}, u'sectors': u'2048', u'start': u'2048', u'holders': [], u'size': u'1.00 MB'}, u'vda2': {u'sectorsize': 512, u'uuid': u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2', u'links': {u'masters': [], u'labels': [u'img-rootfs'], u'ids': [], u'uuids': [u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2']}, u'sectors': u'209711071', u'start': u'4096', u'holders': [], u'size': u'100.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vda'}) >2018-08-30 12:10:33,838 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vdb1': {u'sectorsize': 512, u'uuid': u'e325b6ba-99ca-49d9-90d0-e984779ee379', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': [u'e325b6ba-99ca-49d9-90d0-e984779ee379']}, u'sectors': u'199227359', u'start': u'10487808', u'holders': [], u'size': u'95.00 GB'}, u'vdb2': {u'sectorsize': 512, u'uuid': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'10485760', u'start': u'2048', u'holders': [], u'size': u'5.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vdb'}) >2018-08-30 12:10:33,854 p=7972 u=mistral | TASK [ceph-osd : resolve dedicated device link(s)] ***************************** >2018-08-30 12:10:33,854 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.068) 0:08:20.034 ******* >2018-08-30 12:10:33,900 p=7972 u=mistral | TASK [ceph-osd : set_fact build dedicated_devices from resolved symlinks] ****** >2018-08-30 12:10:33,900 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.045) 0:08:20.080 ******* >2018-08-30 12:10:33,940 p=7972 u=mistral | TASK [ceph-osd : set_fact build final dedicated_devices list] ****************** >2018-08-30 12:10:33,941 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.040) 0:08:20.121 ******* >2018-08-30 12:10:33,970 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:33,982 p=7972 u=mistral | TASK [ceph-osd : read information about the devices] *************************** >2018-08-30 12:10:33,983 p=7972 u=mistral | Thursday 30 August 2018 12:10:33 -0400 (0:00:00.041) 0:08:20.163 ******* >2018-08-30 12:10:34,372 p=7972 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:10:34,387 p=7972 u=mistral | TASK [ceph-osd : check the partition status of the osd disks] ****************** >2018-08-30 12:10:34,387 p=7972 u=mistral | Thursday 30 August 2018 12:10:34 -0400 (0:00:00.404) 0:08:20.568 ******* >2018-08-30 12:10:34,747 p=7972 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:10:34,763 p=7972 u=mistral | TASK [ceph-osd : create gpt disk label] **************************************** >2018-08-30 12:10:34,763 p=7972 u=mistral | Thursday 30 August 2018 12:10:34 -0400 (0:00:00.375) 0:08:20.943 ******* >2018-08-30 12:10:34,811 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'blkid', u'-t', u'PTTYPE=gpt', u'/dev/vdb'], u'end': u'2018-08-30 12:10:35.696796', '_ansible_no_log': False, u'stdout': u'/dev/vdb: PTTYPE="gpt" ', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.011213', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'blkid -t PTTYPE="gpt" /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb: PTTYPE="gpt" '], 'failed_when_result': False, u'start': u'2018-08-30 12:10:35.685583', '_ansible_ignore_errors': None, 'failed': False}, u'/dev/vdb']) >2018-08-30 12:10:34,825 p=7972 u=mistral | TASK [ceph-osd : include scenarios/collocated.yml] ***************************** >2018-08-30 12:10:34,825 p=7972 u=mistral | Thursday 30 August 2018 12:10:34 -0400 (0:00:00.061) 0:08:21.005 ******* >2018-08-30 12:10:34,867 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/scenarios/collocated.yml for 172.16.0.36 >2018-08-30 12:10:34,918 p=7972 u=mistral | TASK [ceph-osd : prepare ceph containerized osd disk collocated] *************** >2018-08-30 12:10:34,918 p=7972 u=mistral | Thursday 30 August 2018 12:10:34 -0400 (0:00:00.093) 0:08:21.099 ******* >2018-08-30 12:10:34,965 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:10:34,980 p=7972 u=mistral | TASK [ceph-osd : automatic prepare ceph containerized osd disk collocated] ***** >2018-08-30 12:10:34,980 p=7972 u=mistral | Thursday 30 August 2018 12:10:34 -0400 (0:00:00.061) 0:08:21.160 ******* >2018-08-30 12:10:35,016 p=7972 u=mistral | skipping: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:10:35,032 p=7972 u=mistral | TASK [ceph-osd : manually prepare ceph "filestore" non-containerized osd disk(s) with collocated osd data and journal] *** >2018-08-30 12:10:35,032 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.051) 0:08:21.212 ******* >2018-08-30 12:10:35,077 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:10:35,093 p=7972 u=mistral | TASK [ceph-osd : include scenarios/non-collocated.yml] ************************* >2018-08-30 12:10:35,093 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.060) 0:08:21.273 ******* >2018-08-30 12:10:35,125 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:35,139 p=7972 u=mistral | TASK [ceph-osd : include scenarios/lvm.yml] ************************************ >2018-08-30 12:10:35,139 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.045) 0:08:21.319 ******* >2018-08-30 12:10:35,167 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:35,179 p=7972 u=mistral | TASK [ceph-osd : include activate_osds.yml] ************************************ >2018-08-30 12:10:35,180 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.040) 0:08:21.360 ******* >2018-08-30 12:10:35,207 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:35,220 p=7972 u=mistral | TASK [ceph-osd : include start_osds.yml] *************************************** >2018-08-30 12:10:35,220 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.040) 0:08:21.400 ******* >2018-08-30 12:10:35,249 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:35,261 p=7972 u=mistral | TASK [ceph-osd : include docker/main.yml] ************************************** >2018-08-30 12:10:35,261 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.040) 0:08:21.441 ******* >2018-08-30 12:10:35,304 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/main.yml for 172.16.0.36 >2018-08-30 12:10:35,363 p=7972 u=mistral | TASK [ceph-osd : include start_docker_osd.yml] ********************************* >2018-08-30 12:10:35,364 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.102) 0:08:21.544 ******* >2018-08-30 12:10:35,405 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/start_docker_osd.yml for 172.16.0.36 >2018-08-30 12:10:35,418 p=7972 u=mistral | TASK [ceph-osd : umount ceph disk (if on openstack)] *************************** >2018-08-30 12:10:35,419 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.054) 0:08:21.599 ******* >2018-08-30 12:10:35,443 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:35,455 p=7972 u=mistral | TASK [ceph-osd : test if the container image has the disk_list function] ******* >2018-08-30 12:10:35,455 p=7972 u=mistral | Thursday 30 August 2018 12:10:35 -0400 (0:00:00.036) 0:08:21.635 ******* >2018-08-30 12:10:36,251 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:36,265 p=7972 u=mistral | TASK [ceph-osd : generate ceph osd docker run script] ************************** >2018-08-30 12:10:36,265 p=7972 u=mistral | Thursday 30 August 2018 12:10:36 -0400 (0:00:00.809) 0:08:22.445 ******* >2018-08-30 12:10:37,507 p=7972 u=mistral | changed: [172.16.0.36] >2018-08-30 12:10:37,518 p=7972 u=mistral | TASK [ceph-osd : generate systemd unit file] *********************************** >2018-08-30 12:10:37,519 p=7972 u=mistral | Thursday 30 August 2018 12:10:37 -0400 (0:00:01.253) 0:08:23.699 ******* >2018-08-30 12:10:38,947 p=7972 u=mistral | changed: [172.16.0.36] >2018-08-30 12:10:38,957 p=7972 u=mistral | TASK [ceph-osd : systemd start osd container] ********************************** >2018-08-30 12:10:38,957 p=7972 u=mistral | Thursday 30 August 2018 12:10:38 -0400 (0:00:01.438) 0:08:25.138 ******* >2018-08-30 12:10:39,730 p=7972 u=mistral | changed: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:10:39,749 p=7972 u=mistral | TASK [ceph-osd : set_fact openstack_keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:10:39,750 p=7972 u=mistral | Thursday 30 August 2018 12:10:39 -0400 (0:00:00.792) 0:08:25.930 ******* >2018-08-30 12:10:39,828 p=7972 u=mistral | ok: [172.16.0.36] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:10:39,875 p=7972 u=mistral | ok: [172.16.0.36] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:10:40,083 p=7972 u=mistral | ok: [172.16.0.36] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:10:40,097 p=7972 u=mistral | TASK [ceph-osd : set_fact keys - override keys_tmp with keys] ****************** >2018-08-30 12:10:40,097 p=7972 u=mistral | Thursday 30 August 2018 12:10:40 -0400 (0:00:00.347) 0:08:26.278 ******* >2018-08-30 12:10:40,168 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:40,203 p=7972 u=mistral | TASK [ceph-osd : wait for all osd to be up] ************************************ >2018-08-30 12:10:40,204 p=7972 u=mistral | Thursday 30 August 2018 12:10:40 -0400 (0:00:00.105) 0:08:26.384 ******* >2018-08-30 12:10:40,240 p=7972 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:10:40,282 p=7972 u=mistral | TASK [ceph-osd : list existing pool(s)] **************************************** >2018-08-30 12:10:40,282 p=7972 u=mistral | Thursday 30 August 2018 12:10:40 -0400 (0:00:00.078) 0:08:26.462 ******* >2018-08-30 12:10:40,329 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,343 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,358 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,375 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,391 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,449 p=7972 u=mistral | TASK [ceph-osd : create openstack pool(s)] ************************************* >2018-08-30 12:10:40,450 p=7972 u=mistral | Thursday 30 August 2018 12:10:40 -0400 (0:00:00.167) 0:08:26.630 ******* >2018-08-30 12:10:40,506 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:10:40,517 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:10:40,534 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:10:40,549 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:10:40,565 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:10:40,608 p=7972 u=mistral | TASK [ceph-osd : assign application to pool(s)] ******************************** >2018-08-30 12:10:40,609 p=7972 u=mistral | Thursday 30 August 2018 12:10:40 -0400 (0:00:00.159) 0:08:26.789 ******* >2018-08-30 12:10:40,661 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,671 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,684 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,697 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,714 p=7972 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:10:40,749 p=7972 u=mistral | TASK [ceph-osd : create openstack cephx key(s)] ******************************** >2018-08-30 12:10:40,750 p=7972 u=mistral | Thursday 30 August 2018 12:10:40 -0400 (0:00:00.140) 0:08:26.930 ******* >2018-08-30 12:10:40,797 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:10:40,808 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:10:40,820 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:10:40,856 p=7972 u=mistral | TASK [ceph-osd : fetch openstack cephx key(s)] ********************************* >2018-08-30 12:10:40,857 p=7972 u=mistral | Thursday 30 August 2018 12:10:40 -0400 (0:00:00.106) 0:08:27.037 ******* >2018-08-30 12:10:40,909 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:10:40,930 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:10:40,945 p=7972 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:10:41,019 p=7972 u=mistral | TASK [ceph-osd : copy to other mons the openstack cephx key(s)] **************** >2018-08-30 12:10:41,020 p=7972 u=mistral | Thursday 30 August 2018 12:10:41 -0400 (0:00:00.163) 0:08:27.200 ******* >2018-08-30 12:10:41,081 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.33', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:10:41,093 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.33', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:10:41,106 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.33', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:10:41,124 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.24', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:10:41,130 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.24', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:10:41,141 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.24', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:10:41,155 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.25', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:10:41,166 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.25', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:10:41,178 p=7972 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.25', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:10:41,181 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:10:41,181 p=7972 u=mistral | Thursday 30 August 2018 12:10:41 -0400 (0:00:00.160) 0:08:27.361 ******* >2018-08-30 12:10:41,265 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:41,266 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:10:41,267 p=7972 u=mistral | Thursday 30 August 2018 12:10:41 -0400 (0:00:00.085) 0:08:27.447 ******* >2018-08-30 12:10:42,181 p=7972 u=mistral | changed: [172.16.0.36] >2018-08-30 12:10:42,182 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:10:42,183 p=7972 u=mistral | Thursday 30 August 2018 12:10:42 -0400 (0:00:00.915) 0:08:28.363 ******* >2018-08-30 12:10:42,263 p=7972 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.28) >2018-08-30 12:10:42,271 p=7972 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:10:42,281 p=7972 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.32) >2018-08-30 12:10:42,282 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:10:42,282 p=7972 u=mistral | Thursday 30 August 2018 12:10:42 -0400 (0:00:00.099) 0:08:28.462 ******* >2018-08-30 12:10:42,372 p=7972 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.28) >2018-08-30 12:10:42,390 p=7972 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:10:42,421 p=7972 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.32) >2018-08-30 12:10:42,422 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:10:42,423 p=7972 u=mistral | Thursday 30 August 2018 12:10:42 -0400 (0:00:00.140) 0:08:28.603 ******* >2018-08-30 12:10:42,488 p=7972 u=mistral | ok: [172.16.0.36] >2018-08-30 12:10:42,517 p=7972 u=mistral | TASK [get num_pgs] ************************************************************* >2018-08-30 12:10:42,517 p=7972 u=mistral | Thursday 30 August 2018 12:10:42 -0400 (0:00:00.094) 0:08:28.697 ******* >2018-08-30 12:10:43,429 p=7972 u=mistral | changed: [172.16.0.36 -> 172.16.0.33] >2018-08-30 12:10:43,455 p=7972 u=mistral | TASK [container - waiting for clean pgs...] ************************************ >2018-08-30 12:10:43,456 p=7972 u=mistral | Thursday 30 August 2018 12:10:43 -0400 (0:00:00.938) 0:08:29.636 ******* >2018-08-30 12:10:44,492 p=7972 u=mistral | FAILED - RETRYING: container - waiting for clean pgs... (5 retries left). >2018-08-30 12:11:00,327 p=7972 u=mistral | FAILED - RETRYING: container - waiting for clean pgs... (4 retries left). >2018-08-30 12:11:16,161 p=7972 u=mistral | FAILED - RETRYING: container - waiting for clean pgs... (3 retries left). >2018-08-30 12:11:31,968 p=7972 u=mistral | FAILED - RETRYING: container - waiting for clean pgs... (2 retries left). >2018-08-30 12:11:47,767 p=7972 u=mistral | changed: [172.16.0.36 -> 172.16.0.33] >2018-08-30 12:11:47,781 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph osd] ************** >2018-08-30 12:11:47,878 p=7972 u=mistral | TASK [collect running osds and ceph-disk unit(s)] ****************************** >2018-08-30 12:11:47,878 p=7972 u=mistral | Thursday 30 August 2018 12:11:47 -0400 (0:01:04.422) 0:09:34.059 ******* >2018-08-30 12:11:48,459 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:48,471 p=7972 u=mistral | TASK [collect osd devices] ***************************************************** >2018-08-30 12:11:48,472 p=7972 u=mistral | Thursday 30 August 2018 12:11:48 -0400 (0:00:00.593) 0:09:34.652 ******* >2018-08-30 12:11:48,499 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:48,512 p=7972 u=mistral | TASK [set devices] ************************************************************* >2018-08-30 12:11:48,512 p=7972 u=mistral | Thursday 30 August 2018 12:11:48 -0400 (0:00:00.040) 0:09:34.693 ******* >2018-08-30 12:11:48,541 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:48,553 p=7972 u=mistral | TASK [stop/disable/mask non-containerized ceph osd(s) and ceph-disk units (if any)] *** >2018-08-30 12:11:48,554 p=7972 u=mistral | Thursday 30 August 2018 12:11:48 -0400 (0:00:00.041) 0:09:34.734 ******* >2018-08-30 12:11:51,829 p=7972 u=mistral | changed: [172.16.0.32] => (item=ceph-osd@2.service) >2018-08-30 12:11:51,852 p=7972 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:11:51,852 p=7972 u=mistral | Thursday 30 August 2018 12:11:51 -0400 (0:00:03.298) 0:09:38.033 ******* >2018-08-30 12:11:51,881 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:51,896 p=7972 u=mistral | TASK [set_fact ceph_uid for red hat] ******************************************* >2018-08-30 12:11:51,897 p=7972 u=mistral | Thursday 30 August 2018 12:11:51 -0400 (0:00:00.044) 0:09:38.077 ******* >2018-08-30 12:11:51,927 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:51,944 p=7972 u=mistral | TASK [set_fact ceph_uid for rhel] ********************************************** >2018-08-30 12:11:51,945 p=7972 u=mistral | Thursday 30 August 2018 12:11:51 -0400 (0:00:00.047) 0:09:38.125 ******* >2018-08-30 12:11:52,007 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:52,021 p=7972 u=mistral | TASK [set proper ownership on ceph directories] ******************************** >2018-08-30 12:11:52,021 p=7972 u=mistral | Thursday 30 August 2018 12:11:52 -0400 (0:00:00.076) 0:09:38.202 ******* >2018-08-30 12:11:53,885 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph) >2018-08-30 12:11:54,185 p=7972 u=mistral | changed: [172.16.0.32] => (item=/etc/ceph) >2018-08-30 12:11:54,199 p=7972 u=mistral | TASK [check for existing old leveldb file extension (ldb)] ********************* >2018-08-30 12:11:54,199 p=7972 u=mistral | Thursday 30 August 2018 12:11:54 -0400 (0:00:02.177) 0:09:40.379 ******* >2018-08-30 12:11:54,516 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:54,538 p=7972 u=mistral | TASK [rename leveldb extension from ldb to sst] ******************************** >2018-08-30 12:11:54,538 p=7972 u=mistral | Thursday 30 August 2018 12:11:54 -0400 (0:00:00.339) 0:09:40.718 ******* >2018-08-30 12:11:54,569 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:54,582 p=7972 u=mistral | TASK [check if containerized osds are already running] ************************* >2018-08-30 12:11:54,582 p=7972 u=mistral | Thursday 30 August 2018 12:11:54 -0400 (0:00:00.044) 0:09:40.763 ******* >2018-08-30 12:11:54,966 p=7972 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:11:54,980 p=7972 u=mistral | TASK [resolve device(s) path(s)] *********************************************** >2018-08-30 12:11:54,980 p=7972 u=mistral | Thursday 30 August 2018 12:11:54 -0400 (0:00:00.397) 0:09:41.160 ******* >2018-08-30 12:11:55,294 p=7972 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:11:55,308 p=7972 u=mistral | TASK [unmount all the osd directories] ***************************************** >2018-08-30 12:11:55,308 p=7972 u=mistral | Thursday 30 August 2018 12:11:55 -0400 (0:00:00.327) 0:09:41.488 ******* >2018-08-30 12:11:55,675 p=7972 u=mistral | ok: [172.16.0.32] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'end': u'2018-08-30 12:11:56.248198', '_ansible_no_log': False, u'stdout': u'/dev/vdb', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.005464', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:11:56.242734', '_ansible_ignore_errors': None, 'failed': False}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': u'docker ps | grep -sq devvdb', u'end': u'2018-08-30 12:11:55.920691', '_ansible_no_log': False, u'stdout': u'', '_ansible_item_result': True, u'changed': False, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': True, u'_raw_params': u'docker ps | grep -sq devvdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, u'start': u'2018-08-30 12:11:55.864240', u'delta': u'0:00:00.056451', 'item': u'/dev/vdb', u'rc': 1, u'msg': u'non-zero return code', 'stdout_lines': [], 'failed_when_result': False, u'stderr': u'', '_ansible_ignore_errors': None, u'failed': False}]) >2018-08-30 12:11:55,694 p=7972 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:11:55,694 p=7972 u=mistral | Thursday 30 August 2018 12:11:55 -0400 (0:00:00.386) 0:09:41.874 ******* >2018-08-30 12:11:55,731 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:55,744 p=7972 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:11:55,744 p=7972 u=mistral | Thursday 30 August 2018 12:11:55 -0400 (0:00:00.050) 0:09:41.925 ******* >2018-08-30 12:11:56,125 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:56,139 p=7972 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:11:56,139 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.394) 0:09:42.320 ******* >2018-08-30 12:11:56,172 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,187 p=7972 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:11:56,187 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.047) 0:09:42.367 ******* >2018-08-30 12:11:56,217 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,231 p=7972 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:11:56,231 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.044) 0:09:42.412 ******* >2018-08-30 12:11:56,263 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,277 p=7972 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:11:56,277 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.045) 0:09:42.457 ******* >2018-08-30 12:11:56,309 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,333 p=7972 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:11:56,333 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.056) 0:09:42.514 ******* >2018-08-30 12:11:56,367 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,388 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:11:56,389 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.054) 0:09:42.569 ******* >2018-08-30 12:11:56,422 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,435 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:11:56,436 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.046) 0:09:42.616 ******* >2018-08-30 12:11:56,468 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,485 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:11:56,485 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.049) 0:09:42.665 ******* >2018-08-30 12:11:56,518 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,541 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:11:56,541 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.056) 0:09:42.722 ******* >2018-08-30 12:11:56,570 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,583 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:11:56,584 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.042) 0:09:42.764 ******* >2018-08-30 12:11:56,614 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,629 p=7972 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:11:56,629 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.045) 0:09:42.809 ******* >2018-08-30 12:11:56,660 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,673 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:11:56,673 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.043) 0:09:42.853 ******* >2018-08-30 12:11:56,702 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,715 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:11:56,715 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.042) 0:09:42.896 ******* >2018-08-30 12:11:56,754 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,767 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:11:56,767 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.051) 0:09:42.947 ******* >2018-08-30 12:11:56,798 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,816 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:11:56,817 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.049) 0:09:42.997 ******* >2018-08-30 12:11:56,848 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,864 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:11:56,865 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.048) 0:09:43.045 ******* >2018-08-30 12:11:56,895 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,911 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:11:56,911 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.046) 0:09:43.091 ******* >2018-08-30 12:11:56,943 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:56,956 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:11:56,957 p=7972 u=mistral | Thursday 30 August 2018 12:11:56 -0400 (0:00:00.045) 0:09:43.137 ******* >2018-08-30 12:11:56,984 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,000 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:11:57,000 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.043) 0:09:43.180 ******* >2018-08-30 12:11:57,037 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,056 p=7972 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:11:57,057 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.056) 0:09:43.237 ******* >2018-08-30 12:11:57,089 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,106 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:11:57,106 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.049) 0:09:43.286 ******* >2018-08-30 12:11:57,141 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,156 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:11:57,157 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.050) 0:09:43.337 ******* >2018-08-30 12:11:57,186 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,200 p=7972 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:11:57,200 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.043) 0:09:43.380 ******* >2018-08-30 12:11:57,232 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,245 p=7972 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:11:57,245 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.045) 0:09:43.426 ******* >2018-08-30 12:11:57,276 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,290 p=7972 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:11:57,291 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.045) 0:09:43.471 ******* >2018-08-30 12:11:57,319 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,334 p=7972 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:11:57,334 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.043) 0:09:43.515 ******* >2018-08-30 12:11:57,367 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,380 p=7972 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:11:57,380 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.045) 0:09:43.560 ******* >2018-08-30 12:11:57,680 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:57,693 p=7972 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:11:57,694 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.313) 0:09:43.874 ******* >2018-08-30 12:11:57,753 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:57,766 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:11:57,767 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.072) 0:09:43.947 ******* >2018-08-30 12:11:57,833 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:57,846 p=7972 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:11:57,846 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.079) 0:09:44.027 ******* >2018-08-30 12:11:57,871 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:57,898 p=7972 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:11:57,898 p=7972 u=mistral | Thursday 30 August 2018 12:11:57 -0400 (0:00:00.051) 0:09:44.078 ******* >2018-08-30 12:11:58,016 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:11:58,042 p=7972 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:11:58,042 p=7972 u=mistral | Thursday 30 August 2018 12:11:58 -0400 (0:00:00.143) 0:09:44.222 ******* >2018-08-30 12:11:58,969 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:11:58,987 p=7972 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:11:58,987 p=7972 u=mistral | Thursday 30 August 2018 12:11:58 -0400 (0:00:00.944) 0:09:45.167 ******* >2018-08-30 12:11:59,228 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] >2018-08-30 12:11:59,246 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:11:59,246 p=7972 u=mistral | Thursday 30 August 2018 12:11:59 -0400 (0:00:00.258) 0:09:45.426 ******* >2018-08-30 12:11:59,280 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:59,299 p=7972 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:11:59,299 p=7972 u=mistral | Thursday 30 August 2018 12:11:59 -0400 (0:00:00.053) 0:09:45.480 ******* >2018-08-30 12:11:59,533 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] >2018-08-30 12:11:59,547 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:11:59,547 p=7972 u=mistral | Thursday 30 August 2018 12:11:59 -0400 (0:00:00.247) 0:09:45.727 ******* >2018-08-30 12:11:59,620 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:59,638 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:11:59,639 p=7972 u=mistral | Thursday 30 August 2018 12:11:59 -0400 (0:00:00.091) 0:09:45.819 ******* >2018-08-30 12:11:59,705 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:11:59,722 p=7972 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:11:59,722 p=7972 u=mistral | Thursday 30 August 2018 12:11:59 -0400 (0:00:00.083) 0:09:45.902 ******* >2018-08-30 12:11:59,745 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:11:59,764 p=7972 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:11:59,764 p=7972 u=mistral | Thursday 30 August 2018 12:11:59 -0400 (0:00:00.041) 0:09:45.944 ******* >2018-08-30 12:12:00,017 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] >2018-08-30 12:12:00,035 p=7972 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:12:00,035 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.271) 0:09:46.215 ******* >2018-08-30 12:12:00,066 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:00,087 p=7972 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:12:00,087 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.051) 0:09:46.267 ******* >2018-08-30 12:12:00,116 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:00,133 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:12:00,134 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.046) 0:09:46.314 ******* >2018-08-30 12:12:00,212 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:00,231 p=7972 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:12:00,232 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.097) 0:09:46.412 ******* >2018-08-30 12:12:00,261 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:00,275 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:12:00,275 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.043) 0:09:46.456 ******* >2018-08-30 12:12:00,349 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:00,363 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:12:00,364 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.088) 0:09:46.544 ******* >2018-08-30 12:12:00,436 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:00,453 p=7972 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:12:00,454 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.089) 0:09:46.634 ******* >2018-08-30 12:12:00,520 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:00,535 p=7972 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:12:00,536 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.082) 0:09:46.716 ******* >2018-08-30 12:12:00,858 p=7972 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:12:00,874 p=7972 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:12:00,875 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.338) 0:09:47.055 ******* >2018-08-30 12:12:00,963 p=7972 u=mistral | ok: [172.16.0.32] => (item={'_ansible_parsed': True, 'stderr_lines': [], '_ansible_item_result': True, u'end': u'2018-08-30 12:12:01.811886', '_ansible_no_log': False, u'stdout': u'/dev/vdb', u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'rc': 0, 'item': u'/dev/vdb', u'delta': u'0:00:00.004648', u'stderr': u'', u'changed': False, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:12:01.807238', '_ansible_ignore_errors': None, 'failed': False}) >2018-08-30 12:12:00,983 p=7972 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:12:00,984 p=7972 u=mistral | Thursday 30 August 2018 12:12:00 -0400 (0:00:00.109) 0:09:47.164 ******* >2018-08-30 12:12:01,060 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:01,073 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:12:01,074 p=7972 u=mistral | Thursday 30 August 2018 12:12:01 -0400 (0:00:00.089) 0:09:47.254 ******* >2018-08-30 12:12:01,111 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:01,124 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:12:01,125 p=7972 u=mistral | Thursday 30 August 2018 12:12:01 -0400 (0:00:00.050) 0:09:47.305 ******* >2018-08-30 12:12:01,161 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:01,175 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:12:01,175 p=7972 u=mistral | Thursday 30 August 2018 12:12:01 -0400 (0:00:00.050) 0:09:47.355 ******* >2018-08-30 12:12:01,219 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:01,232 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:12:01,232 p=7972 u=mistral | Thursday 30 August 2018 12:12:01 -0400 (0:00:00.057) 0:09:47.413 ******* >2018-08-30 12:12:01,274 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:01,287 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:12:01,287 p=7972 u=mistral | Thursday 30 August 2018 12:12:01 -0400 (0:00:00.054) 0:09:47.467 ******* >2018-08-30 12:12:01,359 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:01,371 p=7972 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:12:01,371 p=7972 u=mistral | Thursday 30 August 2018 12:12:01 -0400 (0:00:00.083) 0:09:47.551 ******* >2018-08-30 12:12:01,429 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:01,444 p=7972 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:12:01,445 p=7972 u=mistral | Thursday 30 August 2018 12:12:01 -0400 (0:00:00.073) 0:09:47.625 ******* >2018-08-30 12:12:01,766 p=7972 u=mistral | changed: [172.16.0.32] => (item=/etc/ceph) >2018-08-30 12:12:02,048 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/) >2018-08-30 12:12:02,339 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/mon) >2018-08-30 12:12:02,616 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/osd) >2018-08-30 12:12:02,907 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/mds) >2018-08-30 12:12:03,346 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/tmp) >2018-08-30 12:12:03,669 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:12:04,003 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:12:04,316 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:12:04,624 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:12:04,904 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:12:05,221 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/run/ceph) >2018-08-30 12:12:05,242 p=7972 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:12:05,243 p=7972 u=mistral | Thursday 30 August 2018 12:12:05 -0400 (0:00:03.798) 0:09:51.423 ******* >2018-08-30 12:12:05,279 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:05,293 p=7972 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:12:05,293 p=7972 u=mistral | Thursday 30 August 2018 12:12:05 -0400 (0:00:00.050) 0:09:51.473 ******* >2018-08-30 12:12:05,323 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:05,336 p=7972 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:12:05,336 p=7972 u=mistral | Thursday 30 August 2018 12:12:05 -0400 (0:00:00.043) 0:09:51.516 ******* >2018-08-30 12:12:05,368 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:05,382 p=7972 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:12:05,383 p=7972 u=mistral | Thursday 30 August 2018 12:12:05 -0400 (0:00:00.046) 0:09:51.563 ******* >2018-08-30 12:12:05,712 p=7972 u=mistral | changed: [172.16.0.32] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:12:06,027 p=7972 u=mistral | changed: [172.16.0.32] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:12:06,043 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:12:06,043 p=7972 u=mistral | Thursday 30 August 2018 12:12:06 -0400 (0:00:00.660) 0:09:52.224 ******* >2018-08-30 12:12:06,114 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:06,126 p=7972 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:12:06,126 p=7972 u=mistral | Thursday 30 August 2018 12:12:06 -0400 (0:00:00.083) 0:09:52.307 ******* >2018-08-30 12:12:06,150 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:06,163 p=7972 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:12:06,163 p=7972 u=mistral | Thursday 30 August 2018 12:12:06 -0400 (0:00:00.036) 0:09:52.343 ******* >2018-08-30 12:12:06,498 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:06,512 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:12:06,512 p=7972 u=mistral | Thursday 30 August 2018 12:12:06 -0400 (0:00:00.349) 0:09:52.692 ******* >2018-08-30 12:12:06,574 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:06,588 p=7972 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:12:06,588 p=7972 u=mistral | Thursday 30 August 2018 12:12:06 -0400 (0:00:00.076) 0:09:52.769 ******* >2018-08-30 12:12:06,940 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:06,953 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:12:06,953 p=7972 u=mistral | Thursday 30 August 2018 12:12:06 -0400 (0:00:00.364) 0:09:53.133 ******* >2018-08-30 12:12:07,059 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:07,072 p=7972 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:12:07,073 p=7972 u=mistral | Thursday 30 August 2018 12:12:07 -0400 (0:00:00.119) 0:09:53.253 ******* >2018-08-30 12:12:07,269 p=7972 u=mistral | ok: [172.16.0.32] => (item=172.16.0.33) >2018-08-30 12:12:07,406 p=7972 u=mistral | ok: [172.16.0.32] => (item=172.16.0.24) >2018-08-30 12:12:07,538 p=7972 u=mistral | ok: [172.16.0.32] => (item=172.16.0.25) >2018-08-30 12:12:07,553 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:12:07,553 p=7972 u=mistral | Thursday 30 August 2018 12:12:07 -0400 (0:00:00.480) 0:09:53.733 ******* >2018-08-30 12:12:07,654 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:07,668 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:12:07,668 p=7972 u=mistral | Thursday 30 August 2018 12:12:07 -0400 (0:00:00.115) 0:09:53.848 ******* >2018-08-30 12:12:07,770 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:07,791 p=7972 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:12:07,791 p=7972 u=mistral | Thursday 30 August 2018 12:12:07 -0400 (0:00:00.123) 0:09:53.972 ******* >2018-08-30 12:12:08,104 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:12:08,361 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/etc/ceph/monmap-ceph) >2018-08-30 12:12:08,624 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:12:08,909 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:12:09,195 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:12:09,466 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:12:09,773 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:12:10,057 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller03.keyring) >2018-08-30 12:12:10,327 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller01.keyring) >2018-08-30 12:12:10,601 p=7972 u=mistral | ok: [172.16.0.32 -> localhost] => (item=/etc/ceph/ceph.mgr.lab-controller02.keyring) >2018-08-30 12:12:10,626 p=7972 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:12:10,626 p=7972 u=mistral | Thursday 30 August 2018 12:12:10 -0400 (0:00:02.834) 0:09:56.806 ******* >2018-08-30 12:12:10,762 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:10,823 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/etc/ceph/monmap-ceph', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/monmap-ceph', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/monmap-ceph', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:10,888 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:10,956 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:11,020 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:11,092 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:11,158 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:11,224 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/etc/ceph/ceph.mgr.lab-controller03.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645199.971, u'block_size': 4096, u'inode': 50344677, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'xusr': False, u'atime': 1535645224.152, u'md5': u'855b52e842439169d0faee60df11c0de', u'isdir': False, u'ctime': 1535645199.971, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'14c1cb46b68d2b51f1dfa491346254a203cb0ff1', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller03.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:11,282 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/etc/ceph/ceph.mgr.lab-controller01.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645200.324, u'block_size': 4096, u'inode': 50344678, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'xusr': False, u'atime': 1535645255.581, u'md5': u'766ce60e91448f0c196c1303c2d6a7c4', u'isdir': False, u'ctime': 1535645200.324, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'42599b981d04addb5046bb792a7d4bd1f767ab8b', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller01.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:11,347 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[u'/etc/ceph/ceph.mgr.lab-controller02.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645200.68, u'block_size': 4096, u'inode': 50344679, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'xusr': False, u'atime': 1535645283.235, u'md5': u'516246c66efdfb30f97b8e6819caa58e', u'isdir': False, u'ctime': 1535645200.68, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'2697a3cfce227670e9c71655817435acb758f3a6', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mgr.lab-controller02.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:12:11,371 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:12:11,371 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.744) 0:09:57.551 ******* >2018-08-30 12:12:11,395 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,408 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:12:11,408 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.037) 0:09:57.588 ******* >2018-08-30 12:12:11,429 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,445 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:12:11,445 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.037) 0:09:57.626 ******* >2018-08-30 12:12:11,480 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,493 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:12:11,493 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.047) 0:09:57.673 ******* >2018-08-30 12:12:11,528 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,541 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:12:11,541 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.048) 0:09:57.722 ******* >2018-08-30 12:12:11,576 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,591 p=7972 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:12:11,591 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.049) 0:09:57.772 ******* >2018-08-30 12:12:11,623 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,637 p=7972 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:12:11,637 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.045) 0:09:57.817 ******* >2018-08-30 12:12:11,675 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,688 p=7972 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:12:11,689 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.051) 0:09:57.869 ******* >2018-08-30 12:12:11,717 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,729 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:12:11,729 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.040) 0:09:57.909 ******* >2018-08-30 12:12:11,757 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,770 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:12:11,770 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.041) 0:09:57.951 ******* >2018-08-30 12:12:11,811 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,824 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:12:11,824 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.053) 0:09:58.004 ******* >2018-08-30 12:12:11,854 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,867 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:12:11,867 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.043) 0:09:58.047 ******* >2018-08-30 12:12:11,900 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,914 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:12:11,915 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.047) 0:09:58.095 ******* >2018-08-30 12:12:11,947 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:11,960 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:12:11,961 p=7972 u=mistral | Thursday 30 August 2018 12:12:11 -0400 (0:00:00.046) 0:09:58.141 ******* >2018-08-30 12:12:11,997 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,010 p=7972 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:12:12,010 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.049) 0:09:58.190 ******* >2018-08-30 12:12:12,037 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,056 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:12:12,057 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.046) 0:09:58.237 ******* >2018-08-30 12:12:12,088 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,108 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:12:12,109 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.052) 0:09:58.289 ******* >2018-08-30 12:12:12,144 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,159 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:12:12,159 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.050) 0:09:58.339 ******* >2018-08-30 12:12:12,187 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,202 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:12:12,203 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.043) 0:09:58.383 ******* >2018-08-30 12:12:12,228 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,246 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:12:12,247 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.044) 0:09:58.427 ******* >2018-08-30 12:12:12,275 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,288 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:12:12,288 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.041) 0:09:58.469 ******* >2018-08-30 12:12:12,316 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,328 p=7972 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:12:12,328 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.039) 0:09:58.509 ******* >2018-08-30 12:12:12,356 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,371 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:12:12,371 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.042) 0:09:58.552 ******* >2018-08-30 12:12:12,403 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,418 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:12:12,418 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.046) 0:09:58.598 ******* >2018-08-30 12:12:12,452 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,466 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:12:12,467 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.048) 0:09:58.647 ******* >2018-08-30 12:12:12,496 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,510 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:12:12,510 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.043) 0:09:58.690 ******* >2018-08-30 12:12:12,538 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,552 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:12:12,552 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.041) 0:09:58.732 ******* >2018-08-30 12:12:12,583 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,599 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:12:12,600 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.047) 0:09:58.780 ******* >2018-08-30 12:12:12,635 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,652 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:12:12,652 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.052) 0:09:58.833 ******* >2018-08-30 12:12:12,683 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:12,703 p=7972 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:12:12,704 p=7972 u=mistral | Thursday 30 August 2018 12:12:12 -0400 (0:00:00.051) 0:09:58.884 ******* >2018-08-30 12:12:34,131 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:34,149 p=7972 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:12:34,149 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:21.445) 0:10:20.329 ******* >2018-08-30 12:12:34,545 p=7972 u=mistral | changed: [172.16.0.32] >2018-08-30 12:12:34,563 p=7972 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:12:34,563 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.414) 0:10:20.744 ******* >2018-08-30 12:12:34,630 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:34,644 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:12:34,644 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.080) 0:10:20.824 ******* >2018-08-30 12:12:34,677 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:34,692 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:12:34,692 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.048) 0:10:20.872 ******* >2018-08-30 12:12:34,730 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:34,742 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:12:34,742 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.049) 0:10:20.922 ******* >2018-08-30 12:12:34,772 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:34,788 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:12:34,788 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.046) 0:10:20.969 ******* >2018-08-30 12:12:34,821 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:34,836 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:12:34,836 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.047) 0:10:21.016 ******* >2018-08-30 12:12:34,867 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:34,882 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:12:34,882 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.046) 0:10:21.062 ******* >2018-08-30 12:12:34,915 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:34,932 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:12:34,932 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.050) 0:10:21.113 ******* >2018-08-30 12:12:34,965 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:34,982 p=7972 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:12:34,982 p=7972 u=mistral | Thursday 30 August 2018 12:12:34 -0400 (0:00:00.049) 0:10:21.162 ******* >2018-08-30 12:12:35,016 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:35,029 p=7972 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:12:35,030 p=7972 u=mistral | Thursday 30 August 2018 12:12:35 -0400 (0:00:00.047) 0:10:21.210 ******* >2018-08-30 12:12:35,062 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:35,075 p=7972 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:12:35,075 p=7972 u=mistral | Thursday 30 August 2018 12:12:35 -0400 (0:00:00.045) 0:10:21.255 ******* >2018-08-30 12:12:35,106 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:35,120 p=7972 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:12:35,120 p=7972 u=mistral | Thursday 30 August 2018 12:12:35 -0400 (0:00:00.045) 0:10:21.300 ******* >2018-08-30 12:12:35,148 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:35,161 p=7972 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:12:35,161 p=7972 u=mistral | Thursday 30 August 2018 12:12:35 -0400 (0:00:00.040) 0:10:21.341 ******* >2018-08-30 12:12:36,540 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:36,554 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:12:36,555 p=7972 u=mistral | Thursday 30 August 2018 12:12:36 -0400 (0:00:01.393) 0:10:22.735 ******* >2018-08-30 12:12:36,617 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:36,630 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:12:36,631 p=7972 u=mistral | Thursday 30 August 2018 12:12:36 -0400 (0:00:00.075) 0:10:22.811 ******* >2018-08-30 12:12:36,663 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:36,677 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:12:36,677 p=7972 u=mistral | Thursday 30 August 2018 12:12:36 -0400 (0:00:00.046) 0:10:22.858 ******* >2018-08-30 12:12:36,713 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:36,725 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:12:36,726 p=7972 u=mistral | Thursday 30 August 2018 12:12:36 -0400 (0:00:00.048) 0:10:22.906 ******* >2018-08-30 12:12:36,796 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:36,812 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:12:36,812 p=7972 u=mistral | Thursday 30 August 2018 12:12:36 -0400 (0:00:00.086) 0:10:22.992 ******* >2018-08-30 12:12:36,848 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:36,867 p=7972 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:12:36,867 p=7972 u=mistral | Thursday 30 August 2018 12:12:36 -0400 (0:00:00.054) 0:10:23.047 ******* >2018-08-30 12:12:36,905 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:36,923 p=7972 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:12:36,923 p=7972 u=mistral | Thursday 30 August 2018 12:12:36 -0400 (0:00:00.056) 0:10:23.104 ******* >2018-08-30 12:12:37,276 p=7972 u=mistral | changed: [172.16.0.32] => (item=/etc/ceph) >2018-08-30 12:12:37,560 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:12:37,861 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:12:38,330 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:12:38,651 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:12:38,670 p=7972 u=mistral | TASK [ceph-osd : make sure public_network configured] ************************** >2018-08-30 12:12:38,670 p=7972 u=mistral | Thursday 30 August 2018 12:12:38 -0400 (0:00:01.746) 0:10:24.850 ******* >2018-08-30 12:12:38,700 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:38,712 p=7972 u=mistral | TASK [ceph-osd : make sure cluster_network configured] ************************* >2018-08-30 12:12:38,713 p=7972 u=mistral | Thursday 30 August 2018 12:12:38 -0400 (0:00:00.042) 0:10:24.893 ******* >2018-08-30 12:12:38,740 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:38,752 p=7972 u=mistral | TASK [ceph-osd : make sure journal_size configured] **************************** >2018-08-30 12:12:38,752 p=7972 u=mistral | Thursday 30 August 2018 12:12:38 -0400 (0:00:00.039) 0:10:24.932 ******* >2018-08-30 12:12:38,778 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:38,789 p=7972 u=mistral | TASK [ceph-osd : make sure an osd scenario was chosen] ************************* >2018-08-30 12:12:38,790 p=7972 u=mistral | Thursday 30 August 2018 12:12:38 -0400 (0:00:00.037) 0:10:24.970 ******* >2018-08-30 12:12:38,829 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:38,843 p=7972 u=mistral | TASK [ceph-osd : make sure a valid osd scenario was chosen] ******************** >2018-08-30 12:12:38,843 p=7972 u=mistral | Thursday 30 August 2018 12:12:38 -0400 (0:00:00.053) 0:10:25.023 ******* >2018-08-30 12:12:38,886 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:38,899 p=7972 u=mistral | TASK [ceph-osd : verify devices have been provided] **************************** >2018-08-30 12:12:38,899 p=7972 u=mistral | Thursday 30 August 2018 12:12:38 -0400 (0:00:00.055) 0:10:25.079 ******* >2018-08-30 12:12:38,944 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:38,959 p=7972 u=mistral | TASK [ceph-osd : check if osd_scenario lvm is supported by the selected ceph version] *** >2018-08-30 12:12:38,959 p=7972 u=mistral | Thursday 30 August 2018 12:12:38 -0400 (0:00:00.060) 0:10:25.139 ******* >2018-08-30 12:12:38,995 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,010 p=7972 u=mistral | TASK [ceph-osd : verify lvm_volumes have been provided] ************************ >2018-08-30 12:12:39,011 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.051) 0:10:25.191 ******* >2018-08-30 12:12:39,047 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,061 p=7972 u=mistral | TASK [ceph-osd : make sure the lvm_volumes variable is a list] ***************** >2018-08-30 12:12:39,061 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.050) 0:10:25.241 ******* >2018-08-30 12:12:39,101 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,116 p=7972 u=mistral | TASK [ceph-osd : make sure the devices variable is a list] ********************* >2018-08-30 12:12:39,116 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.055) 0:10:25.297 ******* >2018-08-30 12:12:39,159 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,172 p=7972 u=mistral | TASK [ceph-osd : verify dedicated devices have been provided] ****************** >2018-08-30 12:12:39,172 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.055) 0:10:25.352 ******* >2018-08-30 12:12:39,207 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,220 p=7972 u=mistral | TASK [ceph-osd : make sure the dedicated_devices variable is a list] *********** >2018-08-30 12:12:39,221 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.048) 0:10:25.401 ******* >2018-08-30 12:12:39,260 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,274 p=7972 u=mistral | TASK [ceph-osd : check if bluestore is supported by the selected ceph version] *** >2018-08-30 12:12:39,274 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.053) 0:10:25.455 ******* >2018-08-30 12:12:39,313 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,329 p=7972 u=mistral | TASK [ceph-osd : include system_tuning.yml] ************************************ >2018-08-30 12:12:39,329 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.054) 0:10:25.509 ******* >2018-08-30 12:12:39,377 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/system_tuning.yml for 172.16.0.32 >2018-08-30 12:12:39,424 p=7972 u=mistral | TASK [ceph-osd : disable osd directory parsing by updatedb] ******************** >2018-08-30 12:12:39,424 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.095) 0:10:25.605 ******* >2018-08-30 12:12:39,453 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,466 p=7972 u=mistral | TASK [ceph-osd : disable osd directory path in updatedb.conf] ****************** >2018-08-30 12:12:39,467 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.042) 0:10:25.647 ******* >2018-08-30 12:12:39,494 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:39,508 p=7972 u=mistral | TASK [ceph-osd : create tmpfiles.d directory] ********************************** >2018-08-30 12:12:39,508 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.041) 0:10:25.688 ******* >2018-08-30 12:12:39,833 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:39,847 p=7972 u=mistral | TASK [ceph-osd : disable transparent hugepage] ********************************* >2018-08-30 12:12:39,847 p=7972 u=mistral | Thursday 30 August 2018 12:12:39 -0400 (0:00:00.338) 0:10:26.027 ******* >2018-08-30 12:12:40,735 p=7972 u=mistral | changed: [172.16.0.32] >2018-08-30 12:12:40,748 p=7972 u=mistral | TASK [ceph-osd : get default vm.min_free_kbytes] ******************************* >2018-08-30 12:12:40,748 p=7972 u=mistral | Thursday 30 August 2018 12:12:40 -0400 (0:00:00.901) 0:10:26.929 ******* >2018-08-30 12:12:41,073 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:41,094 p=7972 u=mistral | TASK [ceph-osd : set_fact vm_min_free_kbytes] ********************************** >2018-08-30 12:12:41,094 p=7972 u=mistral | Thursday 30 August 2018 12:12:41 -0400 (0:00:00.345) 0:10:27.274 ******* >2018-08-30 12:12:41,154 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:41,168 p=7972 u=mistral | TASK [ceph-osd : apply operating system tuning] ******************************** >2018-08-30 12:12:41,168 p=7972 u=mistral | Thursday 30 August 2018 12:12:41 -0400 (0:00:00.074) 0:10:27.348 ******* >2018-08-30 12:12:41,833 p=7972 u=mistral | changed: [172.16.0.32] => (item={u'enable': u"(osd_objectstore == 'bluestore')", u'name': u'fs.aio-max-nr', u'value': u'1048576'}) >2018-08-30 12:12:42,422 p=7972 u=mistral | changed: [172.16.0.32] => (item={u'name': u'fs.file-max', u'value': 26234859}) >2018-08-30 12:12:42,757 p=7972 u=mistral | changed: [172.16.0.32] => (item={u'name': u'vm.zone_reclaim_mode', u'value': 0}) >2018-08-30 12:12:43,212 p=7972 u=mistral | changed: [172.16.0.32] => (item={u'name': u'vm.swappiness', u'value': 10}) >2018-08-30 12:12:43,504 p=7972 u=mistral | changed: [172.16.0.32] => (item={u'name': u'vm.min_free_kbytes', u'value': u'67584'}) >2018-08-30 12:12:43,520 p=7972 u=mistral | TASK [ceph-osd : install dependencies] ***************************************** >2018-08-30 12:12:43,520 p=7972 u=mistral | Thursday 30 August 2018 12:12:43 -0400 (0:00:02.351) 0:10:29.700 ******* >2018-08-30 12:12:43,548 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:43,561 p=7972 u=mistral | TASK [ceph-osd : include common.yml] ******************************************* >2018-08-30 12:12:43,561 p=7972 u=mistral | Thursday 30 August 2018 12:12:43 -0400 (0:00:00.040) 0:10:29.741 ******* >2018-08-30 12:12:43,598 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/common.yml for 172.16.0.32 >2018-08-30 12:12:43,637 p=7972 u=mistral | TASK [ceph-osd : create bootstrap-osd and osd directories] ********************* >2018-08-30 12:12:43,638 p=7972 u=mistral | Thursday 30 August 2018 12:12:43 -0400 (0:00:00.076) 0:10:29.818 ******* >2018-08-30 12:12:43,984 p=7972 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-osd/) >2018-08-30 12:12:44,281 p=7972 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/osd/) >2018-08-30 12:12:44,299 p=7972 u=mistral | TASK [ceph-osd : copy ceph key(s) if needed] *********************************** >2018-08-30 12:12:44,299 p=7972 u=mistral | Thursday 30 August 2018 12:12:44 -0400 (0:00:00.661) 0:10:30.479 ******* >2018-08-30 12:12:44,985 p=7972 u=mistral | changed: [172.16.0.32] => (item={u'name': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'copy_key': True}) >2018-08-30 12:12:44,994 p=7972 u=mistral | skipping: [172.16.0.32] => (item={u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:12:45,016 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore'] *** >2018-08-30 12:12:45,017 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.717) 0:10:31.197 ******* >2018-08-30 12:12:45,047 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,060 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options 'ceph_disk_cli_options'] ******* >2018-08-30 12:12:45,061 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.044) 0:10:31.241 ******* >2018-08-30 12:12:45,101 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,120 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph'] ************** >2018-08-30 12:12:45,120 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.059) 0:10:31.300 ******* >2018-08-30 12:12:45,157 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,173 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore --dmcrypt'] *** >2018-08-30 12:12:45,173 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.053) 0:10:31.353 ******* >2018-08-30 12:12:45,201 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,218 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --filestore --dmcrypt'] *** >2018-08-30 12:12:45,218 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.044) 0:10:31.398 ******* >2018-08-30 12:12:45,251 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,267 p=7972 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --dmcrypt'] **** >2018-08-30 12:12:45,267 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.049) 0:10:31.448 ******* >2018-08-30 12:12:45,299 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,317 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e KV_TYPE=etcd -e KV_IP=127.0.0.1 -e KV_PORT=2379'] *** >2018-08-30 12:12:45,317 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.049) 0:10:31.497 ******* >2018-08-30 12:12:45,340 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,354 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:12:45,354 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.037) 0:10:31.534 ******* >2018-08-30 12:12:45,422 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:45,437 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:12:45,437 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.082) 0:10:31.617 ******* >2018-08-30 12:12:45,476 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,490 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:12:45,490 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.053) 0:10:31.670 ******* >2018-08-30 12:12:45,520 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,534 p=7972 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:12:45,535 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.044) 0:10:31.715 ******* >2018-08-30 12:12:45,566 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,578 p=7972 u=mistral | TASK [ceph-osd : set_fact devices generate device list when osd_auto_discovery] *** >2018-08-30 12:12:45,579 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.043) 0:10:31.759 ******* >2018-08-30 12:12:45,623 p=7972 u=mistral | skipping: [172.16.0.32] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vda1': {u'sectorsize': 512, u'uuid': u'2018-08-02-20-03-09-00', u'links': {u'masters': [], u'labels': [u'config-2'], u'ids': [], u'uuids': [u'2018-08-02-20-03-09-00']}, u'sectors': u'2048', u'start': u'2048', u'holders': [], u'size': u'1.00 MB'}, u'vda2': {u'sectorsize': 512, u'uuid': u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2', u'links': {u'masters': [], u'labels': [u'img-rootfs'], u'ids': [], u'uuids': [u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2']}, u'sectors': u'209711071', u'start': u'4096', u'holders': [], u'size': u'100.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vda'}) >2018-08-30 12:12:45,631 p=7972 u=mistral | skipping: [172.16.0.32] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vdb1': {u'sectorsize': 512, u'uuid': u'eb7deb9b-da77-44ba-bdc0-97c895020896', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': [u'eb7deb9b-da77-44ba-bdc0-97c895020896']}, u'sectors': u'199227359', u'start': u'10487808', u'holders': [], u'size': u'95.00 GB'}, u'vdb2': {u'sectorsize': 512, u'uuid': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'10485760', u'start': u'2048', u'holders': [], u'size': u'5.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vdb'}) >2018-08-30 12:12:45,646 p=7972 u=mistral | TASK [ceph-osd : resolve dedicated device link(s)] ***************************** >2018-08-30 12:12:45,646 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.067) 0:10:31.826 ******* >2018-08-30 12:12:45,686 p=7972 u=mistral | TASK [ceph-osd : set_fact build dedicated_devices from resolved symlinks] ****** >2018-08-30 12:12:45,687 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.040) 0:10:31.867 ******* >2018-08-30 12:12:45,727 p=7972 u=mistral | TASK [ceph-osd : set_fact build final dedicated_devices list] ****************** >2018-08-30 12:12:45,728 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.041) 0:10:31.908 ******* >2018-08-30 12:12:45,756 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:45,770 p=7972 u=mistral | TASK [ceph-osd : read information about the devices] *************************** >2018-08-30 12:12:45,770 p=7972 u=mistral | Thursday 30 August 2018 12:12:45 -0400 (0:00:00.042) 0:10:31.951 ******* >2018-08-30 12:12:46,159 p=7972 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:12:46,178 p=7972 u=mistral | TASK [ceph-osd : check the partition status of the osd disks] ****************** >2018-08-30 12:12:46,178 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.407) 0:10:32.358 ******* >2018-08-30 12:12:46,505 p=7972 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:12:46,520 p=7972 u=mistral | TASK [ceph-osd : create gpt disk label] **************************************** >2018-08-30 12:12:46,520 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.342) 0:10:32.700 ******* >2018-08-30 12:12:46,570 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'blkid', u'-t', u'PTTYPE=gpt', u'/dev/vdb'], u'end': u'2018-08-30 12:12:47.457614', '_ansible_no_log': False, u'stdout': u'/dev/vdb: PTTYPE="gpt" ', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.011711', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'blkid -t PTTYPE="gpt" /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb: PTTYPE="gpt" '], 'failed_when_result': False, u'start': u'2018-08-30 12:12:47.445903', '_ansible_ignore_errors': None, 'failed': False}, u'/dev/vdb']) >2018-08-30 12:12:46,587 p=7972 u=mistral | TASK [ceph-osd : include scenarios/collocated.yml] ***************************** >2018-08-30 12:12:46,588 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.067) 0:10:32.768 ******* >2018-08-30 12:12:46,639 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/scenarios/collocated.yml for 172.16.0.32 >2018-08-30 12:12:46,694 p=7972 u=mistral | TASK [ceph-osd : prepare ceph containerized osd disk collocated] *************** >2018-08-30 12:12:46,694 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.106) 0:10:32.874 ******* >2018-08-30 12:12:46,736 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:12:46,759 p=7972 u=mistral | TASK [ceph-osd : automatic prepare ceph containerized osd disk collocated] ***** >2018-08-30 12:12:46,759 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.065) 0:10:32.940 ******* >2018-08-30 12:12:46,793 p=7972 u=mistral | skipping: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:12:46,814 p=7972 u=mistral | TASK [ceph-osd : manually prepare ceph "filestore" non-containerized osd disk(s) with collocated osd data and journal] *** >2018-08-30 12:12:46,815 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.055) 0:10:32.995 ******* >2018-08-30 12:12:46,855 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:12:46,871 p=7972 u=mistral | TASK [ceph-osd : include scenarios/non-collocated.yml] ************************* >2018-08-30 12:12:46,871 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.056) 0:10:33.051 ******* >2018-08-30 12:12:46,898 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:46,913 p=7972 u=mistral | TASK [ceph-osd : include scenarios/lvm.yml] ************************************ >2018-08-30 12:12:46,913 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.042) 0:10:33.093 ******* >2018-08-30 12:12:46,939 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:46,953 p=7972 u=mistral | TASK [ceph-osd : include activate_osds.yml] ************************************ >2018-08-30 12:12:46,953 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.040) 0:10:33.133 ******* >2018-08-30 12:12:46,982 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:46,995 p=7972 u=mistral | TASK [ceph-osd : include start_osds.yml] *************************************** >2018-08-30 12:12:46,995 p=7972 u=mistral | Thursday 30 August 2018 12:12:46 -0400 (0:00:00.041) 0:10:33.175 ******* >2018-08-30 12:12:47,024 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:47,038 p=7972 u=mistral | TASK [ceph-osd : include docker/main.yml] ************************************** >2018-08-30 12:12:47,038 p=7972 u=mistral | Thursday 30 August 2018 12:12:47 -0400 (0:00:00.043) 0:10:33.218 ******* >2018-08-30 12:12:47,076 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/main.yml for 172.16.0.32 >2018-08-30 12:12:47,144 p=7972 u=mistral | TASK [ceph-osd : include start_docker_osd.yml] ********************************* >2018-08-30 12:12:47,144 p=7972 u=mistral | Thursday 30 August 2018 12:12:47 -0400 (0:00:00.106) 0:10:33.324 ******* >2018-08-30 12:12:47,187 p=7972 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/start_docker_osd.yml for 172.16.0.32 >2018-08-30 12:12:47,201 p=7972 u=mistral | TASK [ceph-osd : umount ceph disk (if on openstack)] *************************** >2018-08-30 12:12:47,201 p=7972 u=mistral | Thursday 30 August 2018 12:12:47 -0400 (0:00:00.056) 0:10:33.381 ******* >2018-08-30 12:12:47,225 p=7972 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:12:47,238 p=7972 u=mistral | TASK [ceph-osd : test if the container image has the disk_list function] ******* >2018-08-30 12:12:47,238 p=7972 u=mistral | Thursday 30 August 2018 12:12:47 -0400 (0:00:00.037) 0:10:33.418 ******* >2018-08-30 12:12:48,187 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:48,204 p=7972 u=mistral | TASK [ceph-osd : generate ceph osd docker run script] ************************** >2018-08-30 12:12:48,204 p=7972 u=mistral | Thursday 30 August 2018 12:12:48 -0400 (0:00:00.965) 0:10:34.384 ******* >2018-08-30 12:12:49,615 p=7972 u=mistral | changed: [172.16.0.32] >2018-08-30 12:12:49,625 p=7972 u=mistral | TASK [ceph-osd : generate systemd unit file] *********************************** >2018-08-30 12:12:49,625 p=7972 u=mistral | Thursday 30 August 2018 12:12:49 -0400 (0:00:01.421) 0:10:35.806 ******* >2018-08-30 12:12:51,047 p=7972 u=mistral | changed: [172.16.0.32] >2018-08-30 12:12:51,058 p=7972 u=mistral | TASK [ceph-osd : systemd start osd container] ********************************** >2018-08-30 12:12:51,058 p=7972 u=mistral | Thursday 30 August 2018 12:12:51 -0400 (0:00:01.432) 0:10:37.238 ******* >2018-08-30 12:12:51,785 p=7972 u=mistral | changed: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:12:51,801 p=7972 u=mistral | TASK [ceph-osd : set_fact openstack_keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:12:51,802 p=7972 u=mistral | Thursday 30 August 2018 12:12:51 -0400 (0:00:00.743) 0:10:37.982 ******* >2018-08-30 12:12:52,057 p=7972 u=mistral | ok: [172.16.0.32] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:12:52,088 p=7972 u=mistral | ok: [172.16.0.32] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:12:52,122 p=7972 u=mistral | ok: [172.16.0.32] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:12:52,138 p=7972 u=mistral | TASK [ceph-osd : set_fact keys - override keys_tmp with keys] ****************** >2018-08-30 12:12:52,138 p=7972 u=mistral | Thursday 30 August 2018 12:12:52 -0400 (0:00:00.335) 0:10:38.318 ******* >2018-08-30 12:12:52,378 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:12:52,412 p=7972 u=mistral | TASK [ceph-osd : wait for all osd to be up] ************************************ >2018-08-30 12:12:52,412 p=7972 u=mistral | Thursday 30 August 2018 12:12:52 -0400 (0:00:00.273) 0:10:38.592 ******* >2018-08-30 12:12:54,080 p=7972 u=mistral | FAILED - RETRYING: wait for all osd to be up (30 retries left). >2018-08-30 12:13:05,471 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:13:05,510 p=7972 u=mistral | TASK [ceph-osd : list existing pool(s)] **************************************** >2018-08-30 12:13:05,511 p=7972 u=mistral | Thursday 30 August 2018 12:13:05 -0400 (0:00:13.098) 0:10:51.691 ******* >2018-08-30 12:13:06,610 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:07,465 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:08,324 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:09,154 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:10,060 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:10,120 p=7972 u=mistral | TASK [ceph-osd : create openstack pool(s)] ************************************* >2018-08-30 12:13:10,120 p=7972 u=mistral | Thursday 30 August 2018 12:13:10 -0400 (0:00:04.609) 0:10:56.301 ******* >2018-08-30 12:13:10,210 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'images', u'size'], u'end': u'2018-08-30 12:13:07.555843', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.539856', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get images size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:13:07.015987', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:13:10,244 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'metrics', u'size'], u'end': u'2018-08-30 12:13:08.418321', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.525574', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get metrics size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:13:07.892747', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:13:10,280 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'backups', u'size'], u'end': u'2018-08-30 12:13:09.274387', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.525626', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get backups size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:13:08.748761', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:13:10,310 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'vms', u'size'], u'end': u'2018-08-30 12:13:10.107771', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.522088', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get vms size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:13:09.585683', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:13:10,345 p=7972 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'volumes', u'size'], u'end': u'2018-08-30 12:13:11.009543', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.552958', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get volumes size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:13:10.456585', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:13:10,411 p=7972 u=mistral | TASK [ceph-osd : assign application to pool(s)] ******************************** >2018-08-30 12:13:10,412 p=7972 u=mistral | Thursday 30 August 2018 12:13:10 -0400 (0:00:00.291) 0:10:56.592 ******* >2018-08-30 12:13:12,478 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:13,492 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:14,592 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:15,600 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:16,617 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:13:16,654 p=7972 u=mistral | TASK [ceph-osd : create openstack cephx key(s)] ******************************** >2018-08-30 12:13:16,655 p=7972 u=mistral | Thursday 30 August 2018 12:13:16 -0400 (0:00:06.243) 0:11:02.835 ******* >2018-08-30 12:13:18,702 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:13:20,239 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:13:21,844 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:13:21,880 p=7972 u=mistral | TASK [ceph-osd : fetch openstack cephx key(s)] ********************************* >2018-08-30 12:13:21,881 p=7972 u=mistral | Thursday 30 August 2018 12:13:21 -0400 (0:00:05.225) 0:11:08.061 ******* >2018-08-30 12:13:22,227 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:13:22,678 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:13:22,987 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:13:23,050 p=7972 u=mistral | TASK [ceph-osd : copy to other mons the openstack cephx key(s)] **************** >2018-08-30 12:13:23,050 p=7972 u=mistral | Thursday 30 August 2018 12:13:23 -0400 (0:00:01.169) 0:11:09.230 ******* >2018-08-30 12:13:23,934 p=7972 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item=[u'172.16.0.33', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:13:24,682 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item=[u'172.16.0.33', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:13:25,406 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item=[u'172.16.0.33', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:13:26,223 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.24] => (item=[u'172.16.0.24', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:13:27,032 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.24] => (item=[u'172.16.0.24', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:13:27,862 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.24] => (item=[u'172.16.0.24', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:13:28,668 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.25] => (item=[u'172.16.0.25', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:13:29,461 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.25] => (item=[u'172.16.0.25', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:13:30,321 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.25] => (item=[u'172.16.0.25', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:13:30,330 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:13:30,330 p=7972 u=mistral | Thursday 30 August 2018 12:13:30 -0400 (0:00:07.280) 0:11:16.511 ******* >2018-08-30 12:13:30,587 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:13:30,588 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:13:30,589 p=7972 u=mistral | Thursday 30 August 2018 12:13:30 -0400 (0:00:00.258) 0:11:16.769 ******* >2018-08-30 12:13:31,642 p=7972 u=mistral | changed: [172.16.0.32] >2018-08-30 12:13:31,643 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:13:31,643 p=7972 u=mistral | Thursday 30 August 2018 12:13:31 -0400 (0:00:01.054) 0:11:17.823 ******* >2018-08-30 12:13:31,737 p=7972 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.28) >2018-08-30 12:13:31,746 p=7972 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.36) >2018-08-30 12:13:31,756 p=7972 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:13:31,758 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:13:31,758 p=7972 u=mistral | Thursday 30 August 2018 12:13:31 -0400 (0:00:00.114) 0:11:17.938 ******* >2018-08-30 12:13:31,853 p=7972 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.28) >2018-08-30 12:13:31,876 p=7972 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.36) >2018-08-30 12:13:31,899 p=7972 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:13:31,900 p=7972 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:13:31,901 p=7972 u=mistral | Thursday 30 August 2018 12:13:31 -0400 (0:00:00.142) 0:11:18.081 ******* >2018-08-30 12:13:32,161 p=7972 u=mistral | ok: [172.16.0.32] >2018-08-30 12:13:32,189 p=7972 u=mistral | TASK [get num_pgs] ************************************************************* >2018-08-30 12:13:32,189 p=7972 u=mistral | Thursday 30 August 2018 12:13:32 -0400 (0:00:00.288) 0:11:18.369 ******* >2018-08-30 12:13:33,199 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:13:33,230 p=7972 u=mistral | TASK [container - waiting for clean pgs...] ************************************ >2018-08-30 12:13:33,230 p=7972 u=mistral | Thursday 30 August 2018 12:13:33 -0400 (0:00:01.041) 0:11:19.411 ******* >2018-08-30 12:13:34,233 p=7972 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:13:34,241 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph mds] ************** >2018-08-30 12:13:34,242 p=7972 u=mistral | skipping: no hosts matched >2018-08-30 12:13:34,248 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph rgw] ************** >2018-08-30 12:13:34,248 p=7972 u=mistral | skipping: no hosts matched >2018-08-30 12:13:34,254 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph rbd-mirror] ******* >2018-08-30 12:13:34,255 p=7972 u=mistral | skipping: no hosts matched >2018-08-30 12:13:34,260 p=7972 u=mistral | PLAY [switching from non-containerized to containerized ceph nfs] ************** >2018-08-30 12:13:34,260 p=7972 u=mistral | skipping: no hosts matched >2018-08-30 12:13:34,261 p=7972 u=mistral | PLAY RECAP ********************************************************************* >2018-08-30 12:13:34,261 p=7972 u=mistral | 172.16.0.24 : ok=105 changed=21 unreachable=0 failed=0 >2018-08-30 12:13:34,261 p=7972 u=mistral | 172.16.0.25 : ok=106 changed=21 unreachable=0 failed=0 >2018-08-30 12:13:34,261 p=7972 u=mistral | 172.16.0.28 : ok=74 changed=16 unreachable=0 failed=0 >2018-08-30 12:13:34,261 p=7972 u=mistral | 172.16.0.32 : ok=80 changed=21 unreachable=0 failed=0 >2018-08-30 12:13:34,261 p=7972 u=mistral | 172.16.0.33 : ok=103 changed=22 unreachable=0 failed=0 >2018-08-30 12:13:34,261 p=7972 u=mistral | 172.16.0.36 : ok=74 changed=16 unreachable=0 failed=0 >2018-08-30 12:13:34,261 p=7972 u=mistral | localhost : ok=0 changed=0 unreachable=0 failed=0 >2018-08-30 12:13:34,262 p=7972 u=mistral | Thursday 30 August 2018 12:13:34 -0400 (0:00:01.031) 0:11:20.442 ******* >2018-08-30 12:13:34,262 p=7972 u=mistral | =============================================================================== >2018-08-30 12:13:36,332 p=14044 u=mistral | [DEPRECATION WARNING]: The use of 'include' for tasks has been deprecated. Use >'import_tasks' for static inclusions or 'include_tasks' for dynamic inclusions. > This feature will be removed in a future release. Deprecation warnings can be >disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:13:36,333 p=14044 u=mistral | [DEPRECATION WARNING]: include is kept for backwards compatibility but usage is > discouraged. The module documentation details page may explain more about this > rationale.. This feature will be removed in a future release. Deprecation >warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:13:36,518 p=14044 u=mistral | [DEPRECATION WARNING]: The use of 'static' has been deprecated. Use >'import_tasks' for static inclusion, or 'include_tasks' for dynamic inclusion. >This feature will be removed in a future release. Deprecation warnings can be >disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:13:36,805 p=14044 u=mistral | [DEPRECATION WARNING]: docker is kept for backwards compatibility but usage is >discouraged. The module documentation details page may explain more about this >rationale.. This feature will be removed in a future release. Deprecation >warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. >2018-08-30 12:13:40,360 p=14044 u=mistral | PLAY [confirm whether user really meant to upgrade the cluster] **************** >2018-08-30 12:13:40,374 p=14044 u=mistral | TASK [Gathering Facts] ********************************************************* >2018-08-30 12:13:40,374 p=14044 u=mistral | Thursday 30 August 2018 12:13:40 -0400 (0:00:00.153) 0:00:00.153 ******* >2018-08-30 12:13:41,223 p=14044 u=mistral | ok: [localhost] >2018-08-30 12:13:41,259 p=14044 u=mistral | TASK [exit playbook, if user did not mean to upgrade cluster] ****************** >2018-08-30 12:13:41,259 p=14044 u=mistral | Thursday 30 August 2018 12:13:41 -0400 (0:00:00.884) 0:00:01.038 ******* >2018-08-30 12:13:41,284 p=14044 u=mistral | skipping: [localhost] >2018-08-30 12:13:41,295 p=14044 u=mistral | TASK [fail if no mgr host is present in the inventory] ************************* >2018-08-30 12:13:41,295 p=14044 u=mistral | Thursday 30 August 2018 12:13:41 -0400 (0:00:00.035) 0:00:01.074 ******* >2018-08-30 12:13:41,325 p=14044 u=mistral | skipping: [localhost] >2018-08-30 12:13:41,343 p=14044 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: mdss > >2018-08-30 12:13:41,343 p=14044 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: rgws > >2018-08-30 12:13:41,344 p=14044 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: rbdmirrors > >2018-08-30 12:13:41,344 p=14044 u=mistral | [WARNING]: Could not match supplied host pattern, ignoring: nfss > >2018-08-30 12:13:41,357 p=14044 u=mistral | PLAY [gather facts and check the init system] ********************************** >2018-08-30 12:13:41,370 p=14044 u=mistral | TASK [debug] ******************************************************************* >2018-08-30 12:13:41,371 p=14044 u=mistral | Thursday 30 August 2018 12:13:41 -0400 (0:00:00.075) 0:00:01.150 ******* >2018-08-30 12:13:41,422 p=14044 u=mistral | ok: [172.16.0.33] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,456 p=14044 u=mistral | ok: [172.16.0.24] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,476 p=14044 u=mistral | ok: [172.16.0.25] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,495 p=14044 u=mistral | ok: [172.16.0.28] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,496 p=14044 u=mistral | ok: [172.16.0.36] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,501 p=14044 u=mistral | ok: [172.16.0.32] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,514 p=14044 u=mistral | ok: [172.16.0.22] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,536 p=14044 u=mistral | ok: [172.16.0.31] => { > "msg": "gather facts on all Ceph hosts for following reference" >} >2018-08-30 12:13:41,546 p=14044 u=mistral | TASK [gather facts] ************************************************************ >2018-08-30 12:13:41,547 p=14044 u=mistral | Thursday 30 August 2018 12:13:41 -0400 (0:00:00.175) 0:00:01.326 ******* >2018-08-30 12:13:41,585 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:13:41,603 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:13:41,620 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:13:41,637 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:13:41,656 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:13:41,674 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:13:41,675 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:13:41,690 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:13:41,768 p=14044 u=mistral | TASK [gather and delegate facts] *********************************************** >2018-08-30 12:13:41,768 p=14044 u=mistral | Thursday 30 August 2018 12:13:41 -0400 (0:00:00.221) 0:00:01.547 ******* >2018-08-30 12:13:47,739 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:13:52,911 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:13:58,211 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:14:04,793 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.22] => (item=172.16.0.22) >2018-08-30 12:14:09,692 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.31] => (item=172.16.0.31) >2018-08-30 12:14:15,071 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:14:20,205 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:14:25,469 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:14:26,459 p=14044 u=mistral | TASK [set_fact] **************************************************************** >2018-08-30 12:14:26,460 p=14044 u=mistral | Thursday 30 August 2018 12:14:26 -0400 (0:00:44.691) 0:00:46.239 ******* >2018-08-30 12:14:26,840 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:26,841 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:14:26,842 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:14:26,842 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:14:26,843 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:14:26,866 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:14:26,868 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:14:26,887 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:14:26,910 p=14044 u=mistral | PLAY [upgrade ceph mon cluster] ************************************************ >2018-08-30 12:14:27,044 p=14044 u=mistral | TASK [set mon_host_count] ****************************************************** >2018-08-30 12:14:27,045 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.584) 0:00:46.824 ******* >2018-08-30 12:14:27,103 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:27,118 p=14044 u=mistral | TASK [debug] ******************************************************************* >2018-08-30 12:14:27,118 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.073) 0:00:46.898 ******* >2018-08-30 12:14:27,143 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:27,156 p=14044 u=mistral | TASK [fail when single containerized monitor] ********************************** >2018-08-30 12:14:27,157 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.038) 0:00:46.936 ******* >2018-08-30 12:14:27,181 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:27,193 p=14044 u=mistral | TASK [stop ceph mon] *********************************************************** >2018-08-30 12:14:27,194 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.036) 0:00:46.973 ******* >2018-08-30 12:14:27,219 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:27,233 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:14:27,234 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.039) 0:00:47.013 ******* >2018-08-30 12:14:27,759 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:27,774 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:14:27,775 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.540) 0:00:47.554 ******* >2018-08-30 12:14:27,803 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:27,818 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:14:27,819 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.043) 0:00:47.598 ******* >2018-08-30 12:14:27,849 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:27,864 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:14:27,865 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.045) 0:00:47.644 ******* >2018-08-30 12:14:27,896 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:27,911 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:14:27,911 p=14044 u=mistral | Thursday 30 August 2018 12:14:27 -0400 (0:00:00.046) 0:00:47.690 ******* >2018-08-30 12:14:28,267 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:28,281 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:14:28,282 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.370) 0:00:48.061 ******* >2018-08-30 12:14:28,309 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,323 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:14:28,324 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.042) 0:00:48.103 ******* >2018-08-30 12:14:28,351 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,366 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:14:28,366 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.042) 0:00:48.146 ******* >2018-08-30 12:14:28,393 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,408 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:14:28,408 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.041) 0:00:48.187 ******* >2018-08-30 12:14:28,434 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,450 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:14:28,450 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.041) 0:00:48.229 ******* >2018-08-30 12:14:28,474 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,495 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:14:28,496 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.045) 0:00:48.275 ******* >2018-08-30 12:14:28,526 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,540 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:14:28,540 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.044) 0:00:48.319 ******* >2018-08-30 12:14:28,570 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,584 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:14:28,584 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.044) 0:00:48.364 ******* >2018-08-30 12:14:28,611 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,625 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:14:28,625 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.040) 0:00:48.404 ******* >2018-08-30 12:14:28,652 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,665 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:14:28,666 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.040) 0:00:48.445 ******* >2018-08-30 12:14:28,690 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,704 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:14:28,704 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.038) 0:00:48.483 ******* >2018-08-30 12:14:28,731 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,746 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:14:28,747 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.042) 0:00:48.526 ******* >2018-08-30 12:14:28,775 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,790 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:14:28,791 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.043) 0:00:48.570 ******* >2018-08-30 12:14:28,817 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,837 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:14:28,837 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.046) 0:00:48.617 ******* >2018-08-30 12:14:28,863 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,879 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:14:28,879 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.041) 0:00:48.659 ******* >2018-08-30 12:14:28,913 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,933 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:14:28,934 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.054) 0:00:48.713 ******* >2018-08-30 12:14:28,961 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:28,983 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:14:28,984 p=14044 u=mistral | Thursday 30 August 2018 12:14:28 -0400 (0:00:00.050) 0:00:48.763 ******* >2018-08-30 12:14:29,014 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,030 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:14:29,031 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.046) 0:00:48.810 ******* >2018-08-30 12:14:29,058 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,072 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:14:29,073 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.042) 0:00:48.852 ******* >2018-08-30 12:14:29,099 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,113 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:14:29,113 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.040) 0:00:48.893 ******* >2018-08-30 12:14:29,141 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,156 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:14:29,157 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.043) 0:00:48.936 ******* >2018-08-30 12:14:29,190 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,203 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:14:29,204 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.046) 0:00:48.983 ******* >2018-08-30 12:14:29,233 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,249 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:14:29,249 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.045) 0:00:49.028 ******* >2018-08-30 12:14:29,280 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,295 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:14:29,295 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.046) 0:00:49.075 ******* >2018-08-30 12:14:29,742 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:29,759 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:14:29,759 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.463) 0:00:49.538 ******* >2018-08-30 12:14:29,829 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:29,844 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:14:29,845 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.085) 0:00:49.624 ******* >2018-08-30 12:14:29,913 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:29,933 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:14:29,934 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.089) 0:00:49.713 ******* >2018-08-30 12:14:29,967 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:29,997 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:14:29,997 p=14044 u=mistral | Thursday 30 August 2018 12:14:29 -0400 (0:00:00.063) 0:00:49.777 ******* >2018-08-30 12:14:30,115 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:14:30,146 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:14:30,147 p=14044 u=mistral | Thursday 30 August 2018 12:14:30 -0400 (0:00:00.149) 0:00:49.926 ******* >2018-08-30 12:14:30,183 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:30,210 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:14:30,210 p=14044 u=mistral | Thursday 30 August 2018 12:14:30 -0400 (0:00:00.063) 0:00:49.989 ******* >2018-08-30 12:14:30,462 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:14:30,482 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:14:30,483 p=14044 u=mistral | Thursday 30 August 2018 12:14:30 -0400 (0:00:00.272) 0:00:50.262 ******* >2018-08-30 12:14:30,556 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:30,579 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:14:30,580 p=14044 u=mistral | Thursday 30 August 2018 12:14:30 -0400 (0:00:00.097) 0:00:50.359 ******* >2018-08-30 12:14:31,023 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:14:31,037 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:14:31,037 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.457) 0:00:50.817 ******* >2018-08-30 12:14:31,070 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,093 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:14:31,093 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.055) 0:00:50.873 ******* >2018-08-30 12:14:31,160 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:31,182 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:14:31,182 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.088) 0:00:50.962 ******* >2018-08-30 12:14:31,203 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,225 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:14:31,225 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.042) 0:00:51.004 ******* >2018-08-30 12:14:31,257 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,278 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:14:31,279 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.053) 0:00:51.058 ******* >2018-08-30 12:14:31,305 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,319 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:14:31,319 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.040) 0:00:51.098 ******* >2018-08-30 12:14:31,346 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,358 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:14:31,359 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.039) 0:00:51.138 ******* >2018-08-30 12:14:31,416 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:31,430 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:14:31,430 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.071) 0:00:51.210 ******* >2018-08-30 12:14:31,451 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,464 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:14:31,465 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.034) 0:00:51.244 ******* >2018-08-30 12:14:31,521 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:31,537 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:14:31,537 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.072) 0:00:51.316 ******* >2018-08-30 12:14:31,598 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:31,614 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:14:31,614 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.076) 0:00:51.393 ******* >2018-08-30 12:14:31,671 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:31,685 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:14:31,685 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.071) 0:00:51.465 ******* >2018-08-30 12:14:31,720 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/dev/vdb) >2018-08-30 12:14:31,737 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:14:31,737 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.051) 0:00:51.516 ******* >2018-08-30 12:14:31,770 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:14:31,786 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:14:31,786 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.049) 0:00:51.566 ******* >2018-08-30 12:14:31,811 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,827 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:14:31,827 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.040) 0:00:51.606 ******* >2018-08-30 12:14:31,852 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,867 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:14:31,868 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.040) 0:00:51.647 ******* >2018-08-30 12:14:31,891 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,904 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:14:31,904 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.036) 0:00:51.683 ******* >2018-08-30 12:14:31,934 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,950 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:14:31,950 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.046) 0:00:51.729 ******* >2018-08-30 12:14:31,977 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:31,991 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:14:31,991 p=14044 u=mistral | Thursday 30 August 2018 12:14:31 -0400 (0:00:00.040) 0:00:51.770 ******* >2018-08-30 12:14:32,052 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:32,067 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:14:32,067 p=14044 u=mistral | Thursday 30 August 2018 12:14:32 -0400 (0:00:00.075) 0:00:51.846 ******* >2018-08-30 12:14:32,124 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:32,139 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:14:32,140 p=14044 u=mistral | Thursday 30 August 2018 12:14:32 -0400 (0:00:00.072) 0:00:51.919 ******* >2018-08-30 12:14:32,455 p=14044 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:14:32,740 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/) >2018-08-30 12:14:33,034 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mon) >2018-08-30 12:14:33,322 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/osd) >2018-08-30 12:14:33,615 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mds) >2018-08-30 12:14:33,900 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/tmp) >2018-08-30 12:14:34,362 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:14:34,637 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:14:34,972 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:14:35,256 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:14:35,554 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:14:35,835 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:14:35,857 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:14:35,857 p=14044 u=mistral | Thursday 30 August 2018 12:14:35 -0400 (0:00:03.717) 0:00:55.637 ******* >2018-08-30 12:14:35,883 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:35,898 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:14:35,898 p=14044 u=mistral | Thursday 30 August 2018 12:14:35 -0400 (0:00:00.040) 0:00:55.678 ******* >2018-08-30 12:14:35,926 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:35,944 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:14:35,944 p=14044 u=mistral | Thursday 30 August 2018 12:14:35 -0400 (0:00:00.045) 0:00:55.724 ******* >2018-08-30 12:14:35,969 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:35,990 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:14:35,990 p=14044 u=mistral | Thursday 30 August 2018 12:14:35 -0400 (0:00:00.045) 0:00:55.769 ******* >2018-08-30 12:14:36,020 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,038 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:14:36,038 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.048) 0:00:55.817 ******* >2018-08-30 12:14:36,066 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,087 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:14:36,088 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.049) 0:00:55.867 ******* >2018-08-30 12:14:36,120 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,141 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:14:36,142 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.054) 0:00:55.921 ******* >2018-08-30 12:14:36,172 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,188 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:14:36,188 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.045) 0:00:55.967 ******* >2018-08-30 12:14:36,211 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,224 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:14:36,225 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.036) 0:00:56.004 ******* >2018-08-30 12:14:36,249 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,262 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:14:36,262 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.037) 0:00:56.041 ******* >2018-08-30 12:14:36,287 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,303 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:14:36,304 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.041) 0:00:56.083 ******* >2018-08-30 12:14:36,337 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,358 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:14:36,358 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.054) 0:00:56.137 ******* >2018-08-30 12:14:36,387 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,407 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:14:36,407 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.048) 0:00:56.186 ******* >2018-08-30 12:14:36,444 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,462 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:14:36,462 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.055) 0:00:56.241 ******* >2018-08-30 12:14:36,488 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,503 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:14:36,503 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.040) 0:00:56.282 ******* >2018-08-30 12:14:36,529 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,543 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:14:36,544 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.040) 0:00:56.323 ******* >2018-08-30 12:14:36,570 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,583 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:14:36,584 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.040) 0:00:56.363 ******* >2018-08-30 12:14:36,613 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,628 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:14:36,628 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.044) 0:00:56.407 ******* >2018-08-30 12:14:36,658 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,672 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:14:36,672 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.044) 0:00:56.452 ******* >2018-08-30 12:14:36,703 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,718 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:14:36,718 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.045) 0:00:56.497 ******* >2018-08-30 12:14:36,752 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,769 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:14:36,769 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.050) 0:00:56.548 ******* >2018-08-30 12:14:36,795 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,812 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:14:36,812 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.043) 0:00:56.591 ******* >2018-08-30 12:14:36,840 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,858 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:14:36,859 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.046) 0:00:56.638 ******* >2018-08-30 12:14:36,886 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,907 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:14:36,908 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.049) 0:00:56.687 ******* >2018-08-30 12:14:36,937 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,952 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:14:36,952 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.044) 0:00:56.731 ******* >2018-08-30 12:14:36,979 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:36,994 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:14:36,994 p=14044 u=mistral | Thursday 30 August 2018 12:14:36 -0400 (0:00:00.042) 0:00:56.773 ******* >2018-08-30 12:14:37,017 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,030 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:14:37,031 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.036) 0:00:56.810 ******* >2018-08-30 12:14:37,058 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,074 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-controller03/keyring already exists] *** >2018-08-30 12:14:37,074 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.043) 0:00:56.854 ******* >2018-08-30 12:14:37,102 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,118 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-controller03/keyring doesn't exist] *** >2018-08-30 12:14:37,118 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.043) 0:00:56.897 ******* >2018-08-30 12:14:37,149 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,164 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:14:37,164 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.045) 0:00:56.943 ******* >2018-08-30 12:14:37,191 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,205 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:14:37,205 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.040) 0:00:56.984 ******* >2018-08-30 12:14:37,231 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,244 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:14:37,245 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.039) 0:00:57.024 ******* >2018-08-30 12:14:37,273 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,297 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:14:37,298 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.052) 0:00:57.077 ******* >2018-08-30 12:14:37,322 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,336 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:14:37,336 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.038) 0:00:57.116 ******* >2018-08-30 12:14:37,364 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,378 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:14:37,378 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.041) 0:00:57.157 ******* >2018-08-30 12:14:37,418 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:14:37,423 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/log/ceph) >2018-08-30 12:14:37,437 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:14:37,437 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.059) 0:00:57.217 ******* >2018-08-30 12:14:37,464 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,478 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:14:37,478 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.040) 0:00:57.257 ******* >2018-08-30 12:14:37,507 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,519 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:14:37,519 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.041) 0:00:57.299 ******* >2018-08-30 12:14:37,545 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,560 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:14:37,560 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.040) 0:00:57.339 ******* >2018-08-30 12:14:37,587 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,601 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:14:37,601 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.041) 0:00:57.380 ******* >2018-08-30 12:14:37,628 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,642 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:14:37,642 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.041) 0:00:57.422 ******* >2018-08-30 12:14:37,670 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,684 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:14:37,684 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.041) 0:00:57.463 ******* >2018-08-30 12:14:37,708 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,722 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:14:37,722 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.038) 0:00:57.501 ******* >2018-08-30 12:14:37,760 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,776 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:14:37,777 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.054) 0:00:57.556 ******* >2018-08-30 12:14:37,808 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:37,833 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:14:37,833 p=14044 u=mistral | Thursday 30 August 2018 12:14:37 -0400 (0:00:00.056) 0:00:57.612 ******* >2018-08-30 12:14:38,175 p=14044 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:14:38,479 p=14044 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:14:38,500 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:14:38,500 p=14044 u=mistral | Thursday 30 August 2018 12:14:38 -0400 (0:00:00.667) 0:00:58.280 ******* >2018-08-30 12:14:38,565 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:38,583 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:14:38,584 p=14044 u=mistral | Thursday 30 August 2018 12:14:38 -0400 (0:00:00.083) 0:00:58.363 ******* >2018-08-30 12:14:38,606 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:38,619 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:14:38,619 p=14044 u=mistral | Thursday 30 August 2018 12:14:38 -0400 (0:00:00.035) 0:00:58.399 ******* >2018-08-30 12:14:38,952 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:38,966 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:14:38,966 p=14044 u=mistral | Thursday 30 August 2018 12:14:38 -0400 (0:00:00.346) 0:00:58.745 ******* >2018-08-30 12:14:39,024 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:39,039 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:14:39,040 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.073) 0:00:58.819 ******* >2018-08-30 12:14:39,395 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:39,409 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:14:39,410 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.370) 0:00:59.189 ******* >2018-08-30 12:14:39,447 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:39,463 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:14:39,463 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.053) 0:00:59.242 ******* >2018-08-30 12:14:39,512 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:14:39,532 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:14:39,553 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:14:39,577 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:14:39,578 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.114) 0:00:59.357 ******* >2018-08-30 12:14:39,625 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:39,649 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:14:39,650 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.071) 0:00:59.429 ******* >2018-08-30 12:14:39,691 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:39,714 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:14:39,715 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.065) 0:00:59.494 ******* >2018-08-30 12:14:39,759 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:14:39,760 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.044) 0:00:59.539 ******* >2018-08-30 12:14:39,803 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:14:39,803 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.043) 0:00:59.582 ******* >2018-08-30 12:14:39,831 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:39,846 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:14:39,846 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.043) 0:00:59.625 ******* >2018-08-30 12:14:39,874 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:39,895 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:14:39,895 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.048) 0:00:59.674 ******* >2018-08-30 12:14:39,929 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:39,951 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:14:39,951 p=14044 u=mistral | Thursday 30 August 2018 12:14:39 -0400 (0:00:00.056) 0:00:59.731 ******* >2018-08-30 12:14:39,989 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,008 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:14:40,009 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.057) 0:00:59.788 ******* >2018-08-30 12:14:40,041 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,055 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:14:40,055 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.046) 0:00:59.834 ******* >2018-08-30 12:14:40,084 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,100 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:14:40,100 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.044) 0:00:59.879 ******* >2018-08-30 12:14:40,135 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,151 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:14:40,151 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.051) 0:00:59.930 ******* >2018-08-30 12:14:40,186 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,201 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:14:40,201 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.050) 0:00:59.981 ******* >2018-08-30 12:14:40,580 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:40,602 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:14:40,603 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.401) 0:01:00.382 ******* >2018-08-30 12:14:40,630 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,645 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:14:40,646 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.043) 0:01:00.425 ******* >2018-08-30 12:14:40,676 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,695 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:14:40,695 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.049) 0:01:00.474 ******* >2018-08-30 12:14:40,726 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:40,741 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:14:40,741 p=14044 u=mistral | Thursday 30 August 2018 12:14:40 -0400 (0:00:00.046) 0:01:00.520 ******* >2018-08-30 12:14:41,158 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:41,185 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:14:41,186 p=14044 u=mistral | Thursday 30 August 2018 12:14:41 -0400 (0:00:00.444) 0:01:00.965 ******* >2018-08-30 12:14:41,216 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:41,232 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:14:41,232 p=14044 u=mistral | Thursday 30 August 2018 12:14:41 -0400 (0:00:00.046) 0:01:01.012 ******* >2018-08-30 12:14:41,262 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:41,276 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:14:41,276 p=14044 u=mistral | Thursday 30 August 2018 12:14:41 -0400 (0:00:00.043) 0:01:01.056 ******* >2018-08-30 12:14:41,637 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:41,658 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:14:41,659 p=14044 u=mistral | Thursday 30 August 2018 12:14:41 -0400 (0:00:00.382) 0:01:01.438 ******* >2018-08-30 12:14:41,687 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:41,701 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:14:41,702 p=14044 u=mistral | Thursday 30 August 2018 12:14:41 -0400 (0:00:00.042) 0:01:01.481 ******* >2018-08-30 12:14:41,733 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:41,747 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:14:41,748 p=14044 u=mistral | Thursday 30 August 2018 12:14:41 -0400 (0:00:00.046) 0:01:01.527 ******* >2018-08-30 12:14:41,777 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:41,790 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:14:41,790 p=14044 u=mistral | Thursday 30 August 2018 12:14:41 -0400 (0:00:00.042) 0:01:01.569 ******* >2018-08-30 12:14:42,182 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:42,204 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:14:42,204 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.413) 0:01:01.983 ******* >2018-08-30 12:14:42,234 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:42,250 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:14:42,250 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.045) 0:01:02.029 ******* >2018-08-30 12:14:42,276 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:42,290 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:14:42,290 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.040) 0:01:02.070 ******* >2018-08-30 12:14:42,358 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:42,373 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:14:42,373 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.082) 0:01:02.152 ******* >2018-08-30 12:14:42,402 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:42,418 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:14:42,418 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.044) 0:01:02.197 ******* >2018-08-30 12:14:42,447 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:42,463 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:14:42,463 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.044) 0:01:02.242 ******* >2018-08-30 12:14:42,490 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:42,504 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:14:42,505 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.041) 0:01:02.284 ******* >2018-08-30 12:14:42,576 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:42,598 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:14:42,599 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.093) 0:01:02.378 ******* >2018-08-30 12:14:42,636 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:42,652 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:14:42,652 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.053) 0:01:02.431 ******* >2018-08-30 12:14:42,687 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:42,711 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:14:42,712 p=14044 u=mistral | Thursday 30 August 2018 12:14:42 -0400 (0:00:00.059) 0:01:02.491 ******* >2018-08-30 12:14:43,084 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:43,102 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:14:43,102 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.390) 0:01:02.881 ******* >2018-08-30 12:14:43,470 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:14:43,493 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:14:43,493 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.391) 0:01:03.272 ******* >2018-08-30 12:14:43,557 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:43,572 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:14:43,572 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.079) 0:01:03.352 ******* >2018-08-30 12:14:43,613 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,627 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:14:43,627 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.054) 0:01:03.406 ******* >2018-08-30 12:14:43,656 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,669 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:14:43,670 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.042) 0:01:03.449 ******* >2018-08-30 12:14:43,699 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,714 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:14:43,714 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.044) 0:01:03.493 ******* >2018-08-30 12:14:43,743 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,758 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:14:43,758 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.044) 0:01:03.537 ******* >2018-08-30 12:14:43,793 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,807 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:14:43,807 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.048) 0:01:03.586 ******* >2018-08-30 12:14:43,838 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,854 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:14:43,855 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.047) 0:01:03.634 ******* >2018-08-30 12:14:43,890 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,915 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:14:43,916 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.061) 0:01:03.695 ******* >2018-08-30 12:14:43,947 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:43,961 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:14:43,962 p=14044 u=mistral | Thursday 30 August 2018 12:14:43 -0400 (0:00:00.045) 0:01:03.741 ******* >2018-08-30 12:14:43,988 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:44,002 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:14:44,002 p=14044 u=mistral | Thursday 30 August 2018 12:14:44 -0400 (0:00:00.040) 0:01:03.781 ******* >2018-08-30 12:14:44,033 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:44,047 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:14:44,048 p=14044 u=mistral | Thursday 30 August 2018 12:14:44 -0400 (0:00:00.045) 0:01:03.827 ******* >2018-08-30 12:14:44,081 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:44,095 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:14:44,095 p=14044 u=mistral | Thursday 30 August 2018 12:14:44 -0400 (0:00:00.047) 0:01:03.874 ******* >2018-08-30 12:14:45,060 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:45,074 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:14:45,075 p=14044 u=mistral | Thursday 30 August 2018 12:14:45 -0400 (0:00:00.979) 0:01:04.854 ******* >2018-08-30 12:14:45,134 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:45,150 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:14:45,151 p=14044 u=mistral | Thursday 30 August 2018 12:14:45 -0400 (0:00:00.076) 0:01:04.930 ******* >2018-08-30 12:14:45,181 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:45,195 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:14:45,196 p=14044 u=mistral | Thursday 30 August 2018 12:14:45 -0400 (0:00:00.044) 0:01:04.975 ******* >2018-08-30 12:14:45,225 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:45,240 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:14:45,240 p=14044 u=mistral | Thursday 30 August 2018 12:14:45 -0400 (0:00:00.044) 0:01:05.019 ******* >2018-08-30 12:14:45,301 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:45,317 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:14:45,317 p=14044 u=mistral | Thursday 30 August 2018 12:14:45 -0400 (0:00:00.077) 0:01:05.097 ******* >2018-08-30 12:14:45,346 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:45,371 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:14:45,372 p=14044 u=mistral | Thursday 30 August 2018 12:14:45 -0400 (0:00:00.054) 0:01:05.151 ******* >2018-08-30 12:14:45,406 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:45,427 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:14:45,427 p=14044 u=mistral | Thursday 30 August 2018 12:14:45 -0400 (0:00:00.055) 0:01:05.207 ******* >2018-08-30 12:14:45,787 p=14044 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:14:46,076 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:14:46,545 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:14:46,837 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:14:47,142 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:14:47,163 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:14:47,163 p=14044 u=mistral | Thursday 30 August 2018 12:14:47 -0400 (0:00:01.735) 0:01:06.942 ******* >2018-08-30 12:14:47,191 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:47,209 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:14:47,209 p=14044 u=mistral | Thursday 30 August 2018 12:14:47 -0400 (0:00:00.045) 0:01:06.988 ******* >2018-08-30 12:14:47,240 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:47,263 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:14:47,263 p=14044 u=mistral | Thursday 30 August 2018 12:14:47 -0400 (0:00:00.054) 0:01:07.042 ******* >2018-08-30 12:14:47,524 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:14:47,544 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:14:47,545 p=14044 u=mistral | Thursday 30 August 2018 12:14:47 -0400 (0:00:00.281) 0:01:07.324 ******* >2018-08-30 12:14:47,571 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:47,594 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:14:47,594 p=14044 u=mistral | Thursday 30 August 2018 12:14:47 -0400 (0:00:00.049) 0:01:07.373 ******* >2018-08-30 12:14:47,623 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:47,637 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:14:47,638 p=14044 u=mistral | Thursday 30 August 2018 12:14:47 -0400 (0:00:00.043) 0:01:07.417 ******* >2018-08-30 12:14:47,963 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:14:47,978 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:14:47,979 p=14044 u=mistral | Thursday 30 August 2018 12:14:47 -0400 (0:00:00.341) 0:01:07.758 ******* >2018-08-30 12:14:50,807 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:14:50,819 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:14:50,820 p=14044 u=mistral | Thursday 30 August 2018 12:14:50 -0400 (0:00:02.840) 0:01:10.599 ******* >2018-08-30 12:14:50,852 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:50,866 p=14044 u=mistral | TASK [ceph-mon : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:14:50,866 p=14044 u=mistral | Thursday 30 August 2018 12:14:50 -0400 (0:00:00.046) 0:01:10.646 ******* >2018-08-30 12:14:50,929 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:50,943 p=14044 u=mistral | TASK [ceph-mon : make sure monitor_interface or monitor_address or monitor_address_block is configured] *** >2018-08-30 12:14:50,943 p=14044 u=mistral | Thursday 30 August 2018 12:14:50 -0400 (0:00:00.077) 0:01:10.723 ******* >2018-08-30 12:14:50,979 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,011 p=14044 u=mistral | TASK [ceph-mon : generate monitor initial keyring] ***************************** >2018-08-30 12:14:51,011 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.067) 0:01:10.790 ******* >2018-08-30 12:14:51,042 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,063 p=14044 u=mistral | TASK [ceph-mon : read monitor initial keyring if it already exists] ************ >2018-08-30 12:14:51,063 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.051) 0:01:10.842 ******* >2018-08-30 12:14:51,090 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,106 p=14044 u=mistral | TASK [ceph-mon : create monitor initial keyring] ******************************* >2018-08-30 12:14:51,106 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.042) 0:01:10.885 ******* >2018-08-30 12:14:51,133 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,150 p=14044 u=mistral | TASK [ceph-mon : set initial monitor key permissions] ************************** >2018-08-30 12:14:51,150 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.044) 0:01:10.929 ******* >2018-08-30 12:14:51,181 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,197 p=14044 u=mistral | TASK [ceph-mon : create (and fix ownership of) monitor directory] ************** >2018-08-30 12:14:51,197 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.046) 0:01:10.976 ******* >2018-08-30 12:14:51,230 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,244 p=14044 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap >= ceph_release_num.luminous] *** >2018-08-30 12:14:51,245 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.047) 0:01:11.024 ******* >2018-08-30 12:14:51,273 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,286 p=14044 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap < ceph_release_num.luminous] *** >2018-08-30 12:14:51,286 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.041) 0:01:11.065 ******* >2018-08-30 12:14:51,314 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,328 p=14044 u=mistral | TASK [ceph-mon : create custom admin keyring] ********************************** >2018-08-30 12:14:51,328 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.041) 0:01:11.107 ******* >2018-08-30 12:14:51,361 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,382 p=14044 u=mistral | TASK [ceph-mon : set ownership of admin keyring] ******************************* >2018-08-30 12:14:51,383 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.054) 0:01:11.162 ******* >2018-08-30 12:14:51,414 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,428 p=14044 u=mistral | TASK [ceph-mon : import admin keyring into mon keyring] ************************ >2018-08-30 12:14:51,428 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.045) 0:01:11.207 ******* >2018-08-30 12:14:51,461 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,474 p=14044 u=mistral | TASK [ceph-mon : ceph monitor mkfs with keyring] ******************************* >2018-08-30 12:14:51,475 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.046) 0:01:11.254 ******* >2018-08-30 12:14:51,499 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,521 p=14044 u=mistral | TASK [ceph-mon : ceph monitor mkfs without keyring] **************************** >2018-08-30 12:14:51,522 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.047) 0:01:11.301 ******* >2018-08-30 12:14:51,552 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,569 p=14044 u=mistral | TASK [ceph-mon : ensure systemd service override directory exists] ************* >2018-08-30 12:14:51,569 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.046) 0:01:11.348 ******* >2018-08-30 12:14:51,604 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,623 p=14044 u=mistral | TASK [ceph-mon : add ceph-mon systemd service overrides] *********************** >2018-08-30 12:14:51,624 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.054) 0:01:11.403 ******* >2018-08-30 12:14:51,666 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,688 p=14044 u=mistral | TASK [ceph-mon : start the monitor service] ************************************ >2018-08-30 12:14:51,688 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.064) 0:01:11.467 ******* >2018-08-30 12:14:51,718 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,733 p=14044 u=mistral | TASK [ceph-mon : enable the ceph-mon.target service] *************************** >2018-08-30 12:14:51,734 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.045) 0:01:11.513 ******* >2018-08-30 12:14:51,765 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,779 p=14044 u=mistral | TASK [ceph-mon : include ceph_keys.yml] **************************************** >2018-08-30 12:14:51,779 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.045) 0:01:11.559 ******* >2018-08-30 12:14:51,808 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,822 p=14044 u=mistral | TASK [ceph-mon : collect all the pools] **************************************** >2018-08-30 12:14:51,823 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.043) 0:01:11.602 ******* >2018-08-30 12:14:51,848 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:51,862 p=14044 u=mistral | TASK [ceph-mon : secure the cluster] ******************************************* >2018-08-30 12:14:51,863 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.039) 0:01:11.642 ******* >2018-08-30 12:14:51,908 p=14044 u=mistral | TASK [ceph-mon : set_fact ceph_config_keys] ************************************ >2018-08-30 12:14:51,909 p=14044 u=mistral | Thursday 30 August 2018 12:14:51 -0400 (0:00:00.046) 0:01:11.688 ******* >2018-08-30 12:14:51,986 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:52,002 p=14044 u=mistral | TASK [ceph-mon : register rbd bootstrap key] *********************************** >2018-08-30 12:14:52,002 p=14044 u=mistral | Thursday 30 August 2018 12:14:52 -0400 (0:00:00.093) 0:01:11.781 ******* >2018-08-30 12:14:52,083 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:52,107 p=14044 u=mistral | TASK [ceph-mon : merge rbd bootstrap key to config and keys paths] ************* >2018-08-30 12:14:52,107 p=14044 u=mistral | Thursday 30 August 2018 12:14:52 -0400 (0:00:00.105) 0:01:11.886 ******* >2018-08-30 12:14:52,181 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:52,205 p=14044 u=mistral | TASK [ceph-mon : stat for ceph config and keys] ******************************** >2018-08-30 12:14:52,206 p=14044 u=mistral | Thursday 30 August 2018 12:14:52 -0400 (0:00:00.098) 0:01:11.985 ******* >2018-08-30 12:14:52,481 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:14:52,687 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:14:52,900 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:14:53,120 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:14:53,358 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:14:53,582 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:14:53,610 p=14044 u=mistral | TASK [ceph-mon : try to copy ceph keys] **************************************** >2018-08-30 12:14:53,611 p=14044 u=mistral | Thursday 30 August 2018 12:14:53 -0400 (0:00:01.405) 0:01:13.390 ******* >2018-08-30 12:14:54,429 p=14044 u=mistral | ok: [172.16.0.33] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:14:54,448 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:14:55,132 p=14044 u=mistral | ok: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:14:55,970 p=14044 u=mistral | ok: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:14:56,696 p=14044 u=mistral | ok: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:14:56,726 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:14:56,751 p=14044 u=mistral | TASK [ceph-mon : populate kv_store with default ceph.conf] ********************* >2018-08-30 12:14:56,752 p=14044 u=mistral | Thursday 30 August 2018 12:14:56 -0400 (0:00:03.140) 0:01:16.531 ******* >2018-08-30 12:14:56,785 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:14:56,800 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:56,818 p=14044 u=mistral | TASK [ceph-mon : populate kv_store with custom ceph.conf] ********************** >2018-08-30 12:14:56,819 p=14044 u=mistral | Thursday 30 August 2018 12:14:56 -0400 (0:00:00.066) 0:01:16.598 ******* >2018-08-30 12:14:56,846 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:14:56,855 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:56,871 p=14044 u=mistral | TASK [ceph-mon : delete populate-kv-store docker] ****************************** >2018-08-30 12:14:56,871 p=14044 u=mistral | Thursday 30 August 2018 12:14:56 -0400 (0:00:00.052) 0:01:16.650 ******* >2018-08-30 12:14:56,898 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:14:56,915 p=14044 u=mistral | TASK [ceph-mon : generate systemd unit file] *********************************** >2018-08-30 12:14:56,915 p=14044 u=mistral | Thursday 30 August 2018 12:14:56 -0400 (0:00:00.043) 0:01:16.694 ******* >2018-08-30 12:14:58,096 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:58,112 p=14044 u=mistral | TASK [ceph-mon : systemd start mon container] ********************************** >2018-08-30 12:14:58,112 p=14044 u=mistral | Thursday 30 August 2018 12:14:58 -0400 (0:00:01.197) 0:01:17.891 ******* >2018-08-30 12:14:59,049 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:14:59,064 p=14044 u=mistral | TASK [ceph-mon : configure ceph profile.d aliases] ***************************** >2018-08-30 12:14:59,065 p=14044 u=mistral | Thursday 30 August 2018 12:14:59 -0400 (0:00:00.952) 0:01:18.844 ******* >2018-08-30 12:15:00,149 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:00,165 p=14044 u=mistral | TASK [ceph-mon : wait for monitor socket to exist] ***************************** >2018-08-30 12:15:00,166 p=14044 u=mistral | Thursday 30 August 2018 12:15:00 -0400 (0:00:01.100) 0:01:19.945 ******* >2018-08-30 12:15:00,690 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:15:00,712 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:15:00,713 p=14044 u=mistral | Thursday 30 August 2018 12:15:00 -0400 (0:00:00.547) 0:01:20.492 ******* >2018-08-30 12:15:00,789 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:00,806 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:15:00,806 p=14044 u=mistral | Thursday 30 August 2018 12:15:00 -0400 (0:00:00.093) 0:01:20.585 ******* >2018-08-30 12:15:00,888 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:00,907 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:15:00,908 p=14044 u=mistral | Thursday 30 August 2018 12:15:00 -0400 (0:00:00.101) 0:01:20.687 ******* >2018-08-30 12:15:01,649 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:01,664 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:15:01,664 p=14044 u=mistral | Thursday 30 August 2018 12:15:01 -0400 (0:00:00.755) 0:01:21.443 ******* >2018-08-30 12:15:01,697 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:01,711 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:15:01,712 p=14044 u=mistral | Thursday 30 August 2018 12:15:01 -0400 (0:00:00.047) 0:01:21.491 ******* >2018-08-30 12:15:01,738 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:01,759 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:15:01,759 p=14044 u=mistral | Thursday 30 August 2018 12:15:01 -0400 (0:00:00.047) 0:01:21.538 ******* >2018-08-30 12:15:01,791 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:01,806 p=14044 u=mistral | TASK [ceph-mon : push ceph files to the ansible server] ************************ >2018-08-30 12:15:01,806 p=14044 u=mistral | Thursday 30 August 2018 12:15:01 -0400 (0:00:00.046) 0:01:21.585 ******* >2018-08-30 12:15:01,886 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:15:02,453 p=14044 u=mistral | ok: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:15:02,479 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:15:02,505 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:15:02,531 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:15:02,819 p=14044 u=mistral | ok: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:15:02,839 p=14044 u=mistral | TASK [ceph-mon : create ceph rest api keyring when mon is containerized] ******* >2018-08-30 12:15:02,840 p=14044 u=mistral | Thursday 30 August 2018 12:15:02 -0400 (0:00:01.033) 0:01:22.619 ******* >2018-08-30 12:15:02,870 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:02,889 p=14044 u=mistral | TASK [ceph-mon : create ceph mgr keyring(s) when mon is containerized] ********* >2018-08-30 12:15:02,889 p=14044 u=mistral | Thursday 30 August 2018 12:15:02 -0400 (0:00:00.049) 0:01:22.669 ******* >2018-08-30 12:15:02,931 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:02,937 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:02,947 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:02,964 p=14044 u=mistral | TASK [ceph-mon : stat for ceph mgr key(s)] ************************************* >2018-08-30 12:15:02,964 p=14044 u=mistral | Thursday 30 August 2018 12:15:02 -0400 (0:00:00.074) 0:01:22.743 ******* >2018-08-30 12:15:03,000 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:03,009 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:03,018 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:03,034 p=14044 u=mistral | TASK [ceph-mon : fetch ceph mgr key(s)] **************************************** >2018-08-30 12:15:03,034 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.070) 0:01:22.814 ******* >2018-08-30 12:15:03,074 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.33', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:15:03,083 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.24', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:15:03,093 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.25', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:15:03,108 p=14044 u=mistral | TASK [ceph-mon : configure crush hierarchy] ************************************ >2018-08-30 12:15:03,109 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.074) 0:01:22.888 ******* >2018-08-30 12:15:03,142 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.28) >2018-08-30 12:15:03,149 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.36) >2018-08-30 12:15:03,156 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.32) >2018-08-30 12:15:03,171 p=14044 u=mistral | TASK [ceph-mon : create configured crush rules] ******************************** >2018-08-30 12:15:03,171 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.062) 0:01:22.950 ******* >2018-08-30 12:15:03,208 p=14044 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:15:03,213 p=14044 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:15:03,228 p=14044 u=mistral | TASK [ceph-mon : get id for new default crush rule] **************************** >2018-08-30 12:15:03,229 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.057) 0:01:23.008 ******* >2018-08-30 12:15:03,268 p=14044 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:15:03,276 p=14044 u=mistral | skipping: [172.16.0.33] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:15:03,290 p=14044 u=mistral | TASK [ceph-mon : set_fact info_ceph_default_crush_rule_yaml] ******************* >2018-08-30 12:15:03,290 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.061) 0:01:23.070 ******* >2018-08-30 12:15:03,326 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'HDD', u'name': u'HDD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:15:03,337 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'SSD', u'name': u'SSD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:15:03,352 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_crush_rule to osd_pool_default_crush_replicated_ruleset if release < luminous else osd_pool_default_crush_rule] *** >2018-08-30 12:15:03,352 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.061) 0:01:23.131 ******* >2018-08-30 12:15:03,374 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:03,425 p=14044 u=mistral | TASK [ceph-mon : insert new default crush rule into daemon to prevent restart] *** >2018-08-30 12:15:03,425 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.072) 0:01:23.204 ******* >2018-08-30 12:15:03,459 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:03,465 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:03,470 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:03,529 p=14044 u=mistral | TASK [ceph-mon : add new default crush rule to ceph.conf] ********************** >2018-08-30 12:15:03,529 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.103) 0:01:23.308 ******* >2018-08-30 12:15:03,567 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:03,574 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:03,576 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:03,595 p=14044 u=mistral | TASK [ceph-mon : get default value for osd_pool_default_pg_num] **************** >2018-08-30 12:15:03,595 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.066) 0:01:23.374 ******* >2018-08-30 12:15:03,631 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:03,644 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with pool_default_pg_num (backward compatibility)] *** >2018-08-30 12:15:03,645 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.049) 0:01:23.424 ******* >2018-08-30 12:15:03,675 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:03,691 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with default_pool_default_pg_num.stdout] *** >2018-08-30 12:15:03,691 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.046) 0:01:23.470 ******* >2018-08-30 12:15:03,720 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:03,736 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num ceph_conf_overrides.global.osd_pool_default_pg_num] *** >2018-08-30 12:15:03,736 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.044) 0:01:23.515 ******* >2018-08-30 12:15:03,796 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:03,810 p=14044 u=mistral | TASK [ceph-mon : increase calamari logging level when debug is on] ************* >2018-08-30 12:15:03,811 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.074) 0:01:23.590 ******* >2018-08-30 12:15:03,836 p=14044 u=mistral | skipping: [172.16.0.33] => (item=cthulhu) >2018-08-30 12:15:03,841 p=14044 u=mistral | skipping: [172.16.0.33] => (item=calamari_web) >2018-08-30 12:15:03,857 p=14044 u=mistral | TASK [ceph-mon : initialize the calamari server api] *************************** >2018-08-30 12:15:03,857 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.046) 0:01:23.636 ******* >2018-08-30 12:15:03,878 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:03,879 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:15:03,879 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.022) 0:01:23.658 ******* >2018-08-30 12:15:03,949 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:03,950 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:15:03,951 p=14044 u=mistral | Thursday 30 August 2018 12:15:03 -0400 (0:00:00.071) 0:01:23.730 ******* >2018-08-30 12:15:04,641 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:04,643 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:15:04,643 p=14044 u=mistral | Thursday 30 August 2018 12:15:04 -0400 (0:00:00.692) 0:01:24.422 ******* >2018-08-30 12:15:04,744 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:04,755 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:04,771 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:04,773 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:15:04,773 p=14044 u=mistral | Thursday 30 August 2018 12:15:04 -0400 (0:00:00.130) 0:01:24.553 ******* >2018-08-30 12:15:16,383 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:16,412 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:16,443 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:16,445 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:15:16,445 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:11.671) 0:01:36.224 ******* >2018-08-30 12:15:16,509 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:16,510 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:15:16,510 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:00.065) 0:01:36.290 ******* >2018-08-30 12:15:16,580 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:16,581 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:15:16,581 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:00.070) 0:01:36.361 ******* >2018-08-30 12:15:16,629 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:16,630 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:15:16,630 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:00.048) 0:01:36.409 ******* >2018-08-30 12:15:16,716 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.28) >2018-08-30 12:15:16,724 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.36) >2018-08-30 12:15:16,734 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.32) >2018-08-30 12:15:16,735 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:15:16,735 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:00.105) 0:01:36.515 ******* >2018-08-30 12:15:16,829 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.28) >2018-08-30 12:15:16,833 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.36) >2018-08-30 12:15:16,841 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.32) >2018-08-30 12:15:16,842 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:15:16,843 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:00.107) 0:01:36.622 ******* >2018-08-30 12:15:16,907 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:16,908 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:15:16,909 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:00.065) 0:01:36.688 ******* >2018-08-30 12:15:16,983 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:16,984 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:15:16,984 p=14044 u=mistral | Thursday 30 August 2018 12:15:16 -0400 (0:00:00.075) 0:01:36.764 ******* >2018-08-30 12:15:17,030 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:17,031 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:15:17,032 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.047) 0:01:36.811 ******* >2018-08-30 12:15:17,075 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:15:17,076 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.044) 0:01:36.855 ******* >2018-08-30 12:15:17,118 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:15:17,118 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.042) 0:01:36.897 ******* >2018-08-30 12:15:17,195 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:17,196 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:15:17,196 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.078) 0:01:36.975 ******* >2018-08-30 12:15:17,274 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:17,274 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:15:17,275 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.078) 0:01:37.054 ******* >2018-08-30 12:15:17,316 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:17,317 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:15:17,318 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.042) 0:01:37.097 ******* >2018-08-30 12:15:17,361 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:15:17,361 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.043) 0:01:37.141 ******* >2018-08-30 12:15:17,399 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:15:17,399 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.037) 0:01:37.179 ******* >2018-08-30 12:15:17,467 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:17,468 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:15:17,468 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.068) 0:01:37.247 ******* >2018-08-30 12:15:17,531 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:17,532 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:15:17,532 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.064) 0:01:37.312 ******* >2018-08-30 12:15:17,585 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:17,586 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:15:17,586 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.053) 0:01:37.365 ******* >2018-08-30 12:15:17,630 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:15:17,630 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.044) 0:01:37.410 ******* >2018-08-30 12:15:17,675 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:15:17,676 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.045) 0:01:37.455 ******* >2018-08-30 12:15:17,740 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:17,741 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:15:17,741 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.065) 0:01:37.520 ******* >2018-08-30 12:15:17,806 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:17,807 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:15:17,807 p=14044 u=mistral | Thursday 30 August 2018 12:15:17 -0400 (0:00:00.065) 0:01:37.586 ******* >2018-08-30 12:15:18,528 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:18,529 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:15:18,529 p=14044 u=mistral | Thursday 30 August 2018 12:15:18 -0400 (0:00:00.722) 0:01:38.309 ******* >2018-08-30 12:15:18,630 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:18,639 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:18,649 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:18,653 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:15:18,653 p=14044 u=mistral | Thursday 30 August 2018 12:15:18 -0400 (0:00:00.123) 0:01:38.432 ******* >2018-08-30 12:15:29,671 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:29,704 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:29,735 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:29,737 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:15:29,738 p=14044 u=mistral | Thursday 30 August 2018 12:15:29 -0400 (0:00:11.084) 0:01:49.517 ******* >2018-08-30 12:15:29,804 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:29,821 p=14044 u=mistral | TASK [start ceph mon] ********************************************************** >2018-08-30 12:15:29,821 p=14044 u=mistral | Thursday 30 August 2018 12:15:29 -0400 (0:00:00.083) 0:01:49.600 ******* >2018-08-30 12:15:29,848 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:29,865 p=14044 u=mistral | TASK [restart containerized ceph mon] ****************************************** >2018-08-30 12:15:29,865 p=14044 u=mistral | Thursday 30 August 2018 12:15:29 -0400 (0:00:00.044) 0:01:49.645 ******* >2018-08-30 12:15:30,855 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:15:30,873 p=14044 u=mistral | TASK [set mon_host_count] ****************************************************** >2018-08-30 12:15:30,873 p=14044 u=mistral | Thursday 30 August 2018 12:15:30 -0400 (0:00:01.007) 0:01:50.653 ******* >2018-08-30 12:15:30,933 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:15:30,947 p=14044 u=mistral | TASK [select a running monitor if multiple monitors] *************************** >2018-08-30 12:15:30,947 p=14044 u=mistral | Thursday 30 August 2018 12:15:30 -0400 (0:00:00.073) 0:01:50.727 ******* >2018-08-30 12:15:30,981 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:31,021 p=14044 u=mistral | ok: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:15:31,047 p=14044 u=mistral | ok: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:15:31,061 p=14044 u=mistral | TASK [select first monitor if only one monitor] ******************************** >2018-08-30 12:15:31,061 p=14044 u=mistral | Thursday 30 August 2018 12:15:31 -0400 (0:00:00.113) 0:01:50.841 ******* >2018-08-30 12:15:31,097 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:15:31,127 p=14044 u=mistral | TASK [non container | waiting for the monitor to join the quorum...] *********** >2018-08-30 12:15:31,127 p=14044 u=mistral | Thursday 30 August 2018 12:15:31 -0400 (0:00:00.065) 0:01:50.906 ******* >2018-08-30 12:15:31,158 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:15:31,187 p=14044 u=mistral | TASK [container | waiting for the containerized monitor to join the quorum...] *** >2018-08-30 12:15:31,187 p=14044 u=mistral | Thursday 30 August 2018 12:15:31 -0400 (0:00:00.059) 0:01:50.966 ******* >2018-08-30 12:15:32,195 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.25] >2018-08-30 12:15:32,222 p=14044 u=mistral | TASK [set osd flags] *********************************************************** >2018-08-30 12:15:32,222 p=14044 u=mistral | Thursday 30 August 2018 12:15:32 -0400 (0:00:01.035) 0:01:52.002 ******* >2018-08-30 12:15:32,250 p=14044 u=mistral | skipping: [172.16.0.33] => (item=noout) >2018-08-30 12:15:32,254 p=14044 u=mistral | skipping: [172.16.0.33] => (item=noscrub) >2018-08-30 12:15:32,261 p=14044 u=mistral | skipping: [172.16.0.33] => (item=nodeep-scrub) >2018-08-30 12:15:32,288 p=14044 u=mistral | TASK [set containerized osd flags] ********************************************* >2018-08-30 12:15:32,289 p=14044 u=mistral | Thursday 30 August 2018 12:15:32 -0400 (0:00:00.066) 0:01:52.068 ******* >2018-08-30 12:15:39,641 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.25] => (item=noout) >2018-08-30 12:15:40,657 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.25] => (item=noscrub) >2018-08-30 12:15:42,682 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.25] => (item=nodeep-scrub) >2018-08-30 12:15:42,700 p=14044 u=mistral | PLAY [upgrade ceph mon cluster] ************************************************ >2018-08-30 12:15:42,828 p=14044 u=mistral | TASK [set mon_host_count] ****************************************************** >2018-08-30 12:15:42,829 p=14044 u=mistral | Thursday 30 August 2018 12:15:42 -0400 (0:00:10.539) 0:02:02.608 ******* >2018-08-30 12:15:43,084 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:43,098 p=14044 u=mistral | TASK [debug] ******************************************************************* >2018-08-30 12:15:43,099 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.270) 0:02:02.878 ******* >2018-08-30 12:15:43,317 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:43,330 p=14044 u=mistral | TASK [fail when single containerized monitor] ********************************** >2018-08-30 12:15:43,330 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.231) 0:02:03.109 ******* >2018-08-30 12:15:43,358 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:43,372 p=14044 u=mistral | TASK [stop ceph mon] *********************************************************** >2018-08-30 12:15:43,372 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.042) 0:02:03.152 ******* >2018-08-30 12:15:43,399 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:43,414 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:15:43,415 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.042) 0:02:03.194 ******* >2018-08-30 12:15:43,832 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:43,847 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:15:43,848 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.433) 0:02:03.627 ******* >2018-08-30 12:15:43,883 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:43,899 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:15:43,899 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.051) 0:02:03.678 ******* >2018-08-30 12:15:43,929 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:43,945 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:15:43,946 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.046) 0:02:03.725 ******* >2018-08-30 12:15:43,979 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:43,994 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:15:43,994 p=14044 u=mistral | Thursday 30 August 2018 12:15:43 -0400 (0:00:00.048) 0:02:03.773 ******* >2018-08-30 12:15:44,325 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:44,340 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:15:44,340 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.345) 0:02:04.119 ******* >2018-08-30 12:15:44,374 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,388 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:15:44,388 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.048) 0:02:04.168 ******* >2018-08-30 12:15:44,423 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,438 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:15:44,438 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.049) 0:02:04.217 ******* >2018-08-30 12:15:44,465 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,479 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:15:44,479 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.041) 0:02:04.259 ******* >2018-08-30 12:15:44,509 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,525 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:15:44,525 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.045) 0:02:04.304 ******* >2018-08-30 12:15:44,558 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,574 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:15:44,575 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.049) 0:02:04.354 ******* >2018-08-30 12:15:44,603 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,617 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:15:44,617 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.042) 0:02:04.396 ******* >2018-08-30 12:15:44,645 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,666 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:15:44,666 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.048) 0:02:04.445 ******* >2018-08-30 12:15:44,697 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,715 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:15:44,716 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.049) 0:02:04.495 ******* >2018-08-30 12:15:44,749 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,771 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:15:44,772 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.055) 0:02:04.551 ******* >2018-08-30 12:15:44,802 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,817 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:15:44,817 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.045) 0:02:04.596 ******* >2018-08-30 12:15:44,847 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,868 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:15:44,868 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.051) 0:02:04.648 ******* >2018-08-30 12:15:44,901 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,922 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:15:44,922 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.053) 0:02:04.701 ******* >2018-08-30 12:15:44,952 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:44,969 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:15:44,970 p=14044 u=mistral | Thursday 30 August 2018 12:15:44 -0400 (0:00:00.047) 0:02:04.749 ******* >2018-08-30 12:15:44,999 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,015 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:15:45,016 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.046) 0:02:04.795 ******* >2018-08-30 12:15:45,046 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,066 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:15:45,066 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.050) 0:02:04.846 ******* >2018-08-30 12:15:45,100 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,117 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:15:45,118 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.051) 0:02:04.897 ******* >2018-08-30 12:15:45,164 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,181 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:15:45,182 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.064) 0:02:04.961 ******* >2018-08-30 12:15:45,218 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,235 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:15:45,236 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.054) 0:02:05.015 ******* >2018-08-30 12:15:45,266 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,281 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:15:45,281 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.045) 0:02:05.061 ******* >2018-08-30 12:15:45,317 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,336 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:15:45,336 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.055) 0:02:05.116 ******* >2018-08-30 12:15:45,367 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,380 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:15:45,381 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.044) 0:02:05.160 ******* >2018-08-30 12:15:45,407 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,421 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:15:45,421 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.040) 0:02:05.200 ******* >2018-08-30 12:15:45,453 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:45,476 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:15:45,477 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.055) 0:02:05.256 ******* >2018-08-30 12:15:45,814 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:45,834 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:15:45,834 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.357) 0:02:05.614 ******* >2018-08-30 12:15:45,895 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:45,910 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:15:45,911 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.076) 0:02:05.690 ******* >2018-08-30 12:15:45,973 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:45,991 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:15:45,992 p=14044 u=mistral | Thursday 30 August 2018 12:15:45 -0400 (0:00:00.081) 0:02:05.771 ******* >2018-08-30 12:15:46,015 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:46,045 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:15:46,045 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.053) 0:02:05.825 ******* >2018-08-30 12:15:46,151 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:15:46,190 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:15:46,190 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.145) 0:02:05.970 ******* >2018-08-30 12:15:46,222 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:46,244 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:15:46,245 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.054) 0:02:06.024 ******* >2018-08-30 12:15:46,474 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:15:46,488 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:15:46,489 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.243) 0:02:06.268 ******* >2018-08-30 12:15:46,556 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:46,584 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:15:46,584 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.095) 0:02:06.363 ******* >2018-08-30 12:15:46,827 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:15:46,842 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:15:46,842 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.258) 0:02:06.621 ******* >2018-08-30 12:15:46,870 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:46,887 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:15:46,887 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.044) 0:02:06.666 ******* >2018-08-30 12:15:46,947 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:46,968 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:15:46,968 p=14044 u=mistral | Thursday 30 August 2018 12:15:46 -0400 (0:00:00.080) 0:02:06.747 ******* >2018-08-30 12:15:46,988 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,008 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:15:47,009 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.040) 0:02:06.788 ******* >2018-08-30 12:15:47,039 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,059 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:15:47,059 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.050) 0:02:06.838 ******* >2018-08-30 12:15:47,084 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,096 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:15:47,096 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.036) 0:02:06.875 ******* >2018-08-30 12:15:47,116 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,129 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:15:47,129 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.033) 0:02:06.909 ******* >2018-08-30 12:15:47,200 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:47,213 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:15:47,213 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.083) 0:02:06.992 ******* >2018-08-30 12:15:47,237 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,251 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:15:47,251 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.037) 0:02:07.030 ******* >2018-08-30 12:15:47,318 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:47,332 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:15:47,332 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.080) 0:02:07.111 ******* >2018-08-30 12:15:47,395 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:47,409 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:15:47,409 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.077) 0:02:07.189 ******* >2018-08-30 12:15:47,473 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:47,487 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:15:47,487 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.077) 0:02:07.266 ******* >2018-08-30 12:15:47,525 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/dev/vdb) >2018-08-30 12:15:47,539 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:15:47,539 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.052) 0:02:07.318 ******* >2018-08-30 12:15:47,578 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:15:47,592 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:15:47,592 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.053) 0:02:07.372 ******* >2018-08-30 12:15:47,623 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,641 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:15:47,641 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.048) 0:02:07.420 ******* >2018-08-30 12:15:47,677 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,694 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:15:47,694 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.053) 0:02:07.473 ******* >2018-08-30 12:15:47,728 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,746 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:15:47,746 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.051) 0:02:07.525 ******* >2018-08-30 12:15:47,783 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,798 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:15:47,799 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.052) 0:02:07.578 ******* >2018-08-30 12:15:47,832 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:47,848 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:15:47,848 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.049) 0:02:07.627 ******* >2018-08-30 12:15:47,929 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:47,942 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:15:47,942 p=14044 u=mistral | Thursday 30 August 2018 12:15:47 -0400 (0:00:00.094) 0:02:07.722 ******* >2018-08-30 12:15:47,997 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:48,012 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:15:48,012 p=14044 u=mistral | Thursday 30 August 2018 12:15:48 -0400 (0:00:00.069) 0:02:07.792 ******* >2018-08-30 12:15:48,370 p=14044 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:15:48,661 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/) >2018-08-30 12:15:48,948 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mon) >2018-08-30 12:15:49,208 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/osd) >2018-08-30 12:15:49,505 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mds) >2018-08-30 12:15:49,775 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/tmp) >2018-08-30 12:15:50,045 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:15:50,330 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:15:50,780 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:15:51,061 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:15:51,346 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:15:51,637 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:15:51,658 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:15:51,658 p=14044 u=mistral | Thursday 30 August 2018 12:15:51 -0400 (0:00:03.646) 0:02:11.438 ******* >2018-08-30 12:15:51,687 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:51,706 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:15:51,706 p=14044 u=mistral | Thursday 30 August 2018 12:15:51 -0400 (0:00:00.047) 0:02:11.485 ******* >2018-08-30 12:15:51,741 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:51,766 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:15:51,767 p=14044 u=mistral | Thursday 30 August 2018 12:15:51 -0400 (0:00:00.060) 0:02:11.546 ******* >2018-08-30 12:15:51,803 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:51,821 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:15:51,822 p=14044 u=mistral | Thursday 30 August 2018 12:15:51 -0400 (0:00:00.054) 0:02:11.601 ******* >2018-08-30 12:15:51,856 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:51,871 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:15:51,871 p=14044 u=mistral | Thursday 30 August 2018 12:15:51 -0400 (0:00:00.049) 0:02:11.650 ******* >2018-08-30 12:15:51,905 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:51,919 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:15:51,920 p=14044 u=mistral | Thursday 30 August 2018 12:15:51 -0400 (0:00:00.048) 0:02:11.699 ******* >2018-08-30 12:15:51,950 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:51,965 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:15:51,965 p=14044 u=mistral | Thursday 30 August 2018 12:15:51 -0400 (0:00:00.044) 0:02:11.744 ******* >2018-08-30 12:15:51,995 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,016 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:15:52,017 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.051) 0:02:11.796 ******* >2018-08-30 12:15:52,047 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,061 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:15:52,061 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.044) 0:02:11.840 ******* >2018-08-30 12:15:52,093 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,107 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:15:52,107 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.046) 0:02:11.887 ******* >2018-08-30 12:15:52,135 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,150 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:15:52,150 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.042) 0:02:11.929 ******* >2018-08-30 12:15:52,178 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,194 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:15:52,194 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.044) 0:02:11.974 ******* >2018-08-30 12:15:52,222 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,237 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:15:52,237 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.042) 0:02:12.016 ******* >2018-08-30 12:15:52,265 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,280 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:15:52,280 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.042) 0:02:12.059 ******* >2018-08-30 12:15:52,308 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,323 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:15:52,324 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.043) 0:02:12.103 ******* >2018-08-30 12:15:52,350 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,368 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:15:52,369 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.044) 0:02:12.148 ******* >2018-08-30 12:15:52,396 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,411 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:15:52,411 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.042) 0:02:12.190 ******* >2018-08-30 12:15:52,450 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,464 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:15:52,465 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.053) 0:02:12.244 ******* >2018-08-30 12:15:52,499 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,514 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:15:52,514 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.049) 0:02:12.293 ******* >2018-08-30 12:15:52,542 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,557 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:15:52,557 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.043) 0:02:12.337 ******* >2018-08-30 12:15:52,587 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,601 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:15:52,601 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.043) 0:02:12.380 ******* >2018-08-30 12:15:52,637 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,651 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:15:52,652 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.050) 0:02:12.431 ******* >2018-08-30 12:15:52,692 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,707 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:15:52,707 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.055) 0:02:12.487 ******* >2018-08-30 12:15:52,745 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,761 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:15:52,761 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.053) 0:02:12.540 ******* >2018-08-30 12:15:52,796 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,814 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:15:52,814 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.053) 0:02:12.594 ******* >2018-08-30 12:15:52,853 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,868 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:15:52,868 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.053) 0:02:12.648 ******* >2018-08-30 12:15:52,903 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,918 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:15:52,918 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.049) 0:02:12.697 ******* >2018-08-30 12:15:52,948 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:52,965 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-controller01/keyring already exists] *** >2018-08-30 12:15:52,965 p=14044 u=mistral | Thursday 30 August 2018 12:15:52 -0400 (0:00:00.047) 0:02:12.744 ******* >2018-08-30 12:15:52,997 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,015 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-controller01/keyring doesn't exist] *** >2018-08-30 12:15:53,015 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.049) 0:02:12.794 ******* >2018-08-30 12:15:53,044 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,067 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:15:53,067 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.051) 0:02:12.846 ******* >2018-08-30 12:15:53,098 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,117 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:15:53,118 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.050) 0:02:12.897 ******* >2018-08-30 12:15:53,150 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,166 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:15:53,166 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.048) 0:02:12.945 ******* >2018-08-30 12:15:53,196 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,222 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:15:53,222 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.055) 0:02:13.001 ******* >2018-08-30 12:15:53,252 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,266 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:15:53,266 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.044) 0:02:13.046 ******* >2018-08-30 12:15:53,299 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,312 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:15:53,313 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.046) 0:02:13.092 ******* >2018-08-30 12:15:53,359 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:15:53,370 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/log/ceph) >2018-08-30 12:15:53,385 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:15:53,385 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.072) 0:02:13.164 ******* >2018-08-30 12:15:53,419 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,434 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:15:53,435 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.049) 0:02:13.214 ******* >2018-08-30 12:15:53,464 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,478 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:15:53,479 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.043) 0:02:13.258 ******* >2018-08-30 12:15:53,508 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,525 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:15:53,525 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.046) 0:02:13.304 ******* >2018-08-30 12:15:53,553 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,568 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:15:53,568 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.042) 0:02:13.347 ******* >2018-08-30 12:15:53,597 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,612 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:15:53,612 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.043) 0:02:13.391 ******* >2018-08-30 12:15:53,654 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,669 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:15:53,670 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.057) 0:02:13.449 ******* >2018-08-30 12:15:53,704 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,718 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:15:53,719 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.048) 0:02:13.498 ******* >2018-08-30 12:15:53,766 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,782 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:15:53,782 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.062) 0:02:13.561 ******* >2018-08-30 12:15:53,812 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:53,829 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:15:53,829 p=14044 u=mistral | Thursday 30 August 2018 12:15:53 -0400 (0:00:00.047) 0:02:13.609 ******* >2018-08-30 12:15:54,211 p=14044 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:15:54,497 p=14044 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:15:54,513 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:15:54,514 p=14044 u=mistral | Thursday 30 August 2018 12:15:54 -0400 (0:00:00.684) 0:02:14.293 ******* >2018-08-30 12:15:54,584 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:54,598 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:15:54,598 p=14044 u=mistral | Thursday 30 August 2018 12:15:54 -0400 (0:00:00.084) 0:02:14.378 ******* >2018-08-30 12:15:54,622 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:54,634 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:15:54,635 p=14044 u=mistral | Thursday 30 August 2018 12:15:54 -0400 (0:00:00.036) 0:02:14.414 ******* >2018-08-30 12:15:54,972 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:54,986 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:15:54,987 p=14044 u=mistral | Thursday 30 August 2018 12:15:54 -0400 (0:00:00.351) 0:02:14.766 ******* >2018-08-30 12:15:55,055 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:55,069 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:15:55,069 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.082) 0:02:14.848 ******* >2018-08-30 12:15:55,435 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:55,449 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:15:55,450 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.380) 0:02:15.229 ******* >2018-08-30 12:15:55,488 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:55,502 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:15:55,502 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.052) 0:02:15.282 ******* >2018-08-30 12:15:55,560 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:15:55,577 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:15:55,596 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:15:55,615 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:15:55,615 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.112) 0:02:15.394 ******* >2018-08-30 12:15:55,658 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:55,673 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:15:55,673 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.057) 0:02:15.452 ******* >2018-08-30 12:15:55,711 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:55,730 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:15:55,730 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.056) 0:02:15.509 ******* >2018-08-30 12:15:55,771 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:15:55,771 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.041) 0:02:15.550 ******* >2018-08-30 12:15:55,815 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:15:55,815 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.044) 0:02:15.594 ******* >2018-08-30 12:15:55,843 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:55,859 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:15:55,859 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.043) 0:02:15.638 ******* >2018-08-30 12:15:55,887 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:55,909 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:15:55,910 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.050) 0:02:15.689 ******* >2018-08-30 12:15:55,955 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:55,977 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:15:55,977 p=14044 u=mistral | Thursday 30 August 2018 12:15:55 -0400 (0:00:00.067) 0:02:15.756 ******* >2018-08-30 12:15:56,012 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,033 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:15:56,036 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.056) 0:02:15.813 ******* >2018-08-30 12:15:56,070 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,086 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:15:56,087 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.052) 0:02:15.866 ******* >2018-08-30 12:15:56,118 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,134 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:15:56,134 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.047) 0:02:15.913 ******* >2018-08-30 12:15:56,164 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,179 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:15:56,179 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.044) 0:02:15.958 ******* >2018-08-30 12:15:56,216 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,233 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:15:56,233 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.053) 0:02:16.012 ******* >2018-08-30 12:15:56,625 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:56,647 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:15:56,648 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.414) 0:02:16.427 ******* >2018-08-30 12:15:56,679 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,694 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:15:56,694 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.046) 0:02:16.473 ******* >2018-08-30 12:15:56,724 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,743 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:15:56,744 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.049) 0:02:16.523 ******* >2018-08-30 12:15:56,785 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:56,801 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:15:56,801 p=14044 u=mistral | Thursday 30 August 2018 12:15:56 -0400 (0:00:00.056) 0:02:16.580 ******* >2018-08-30 12:15:57,221 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:57,243 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:15:57,243 p=14044 u=mistral | Thursday 30 August 2018 12:15:57 -0400 (0:00:00.442) 0:02:17.022 ******* >2018-08-30 12:15:57,275 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:57,289 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:15:57,289 p=14044 u=mistral | Thursday 30 August 2018 12:15:57 -0400 (0:00:00.045) 0:02:17.068 ******* >2018-08-30 12:15:57,326 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:57,341 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:15:57,341 p=14044 u=mistral | Thursday 30 August 2018 12:15:57 -0400 (0:00:00.052) 0:02:17.121 ******* >2018-08-30 12:15:57,723 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:57,745 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:15:57,745 p=14044 u=mistral | Thursday 30 August 2018 12:15:57 -0400 (0:00:00.403) 0:02:17.524 ******* >2018-08-30 12:15:57,774 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:57,790 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:15:57,790 p=14044 u=mistral | Thursday 30 August 2018 12:15:57 -0400 (0:00:00.045) 0:02:17.569 ******* >2018-08-30 12:15:57,826 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:57,839 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:15:57,839 p=14044 u=mistral | Thursday 30 August 2018 12:15:57 -0400 (0:00:00.048) 0:02:17.618 ******* >2018-08-30 12:15:57,868 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:57,885 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:15:57,886 p=14044 u=mistral | Thursday 30 August 2018 12:15:57 -0400 (0:00:00.046) 0:02:17.665 ******* >2018-08-30 12:15:58,248 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:58,268 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:15:58,268 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.382) 0:02:18.047 ******* >2018-08-30 12:15:58,296 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:58,310 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:15:58,310 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.042) 0:02:18.090 ******* >2018-08-30 12:15:58,338 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:58,353 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:15:58,353 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.042) 0:02:18.132 ******* >2018-08-30 12:15:58,437 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:58,454 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:15:58,454 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.101) 0:02:18.233 ******* >2018-08-30 12:15:58,490 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:58,506 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:15:58,507 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.052) 0:02:18.286 ******* >2018-08-30 12:15:58,538 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:58,555 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:15:58,555 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.048) 0:02:18.334 ******* >2018-08-30 12:15:58,584 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:58,601 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:15:58,602 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.046) 0:02:18.381 ******* >2018-08-30 12:15:58,677 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:58,692 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:15:58,693 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.091) 0:02:18.472 ******* >2018-08-30 12:15:58,724 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:58,751 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:15:58,751 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.058) 0:02:18.530 ******* >2018-08-30 12:15:58,783 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:58,812 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:15:58,813 p=14044 u=mistral | Thursday 30 August 2018 12:15:58 -0400 (0:00:00.061) 0:02:18.592 ******* >2018-08-30 12:15:59,301 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:59,321 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:15:59,321 p=14044 u=mistral | Thursday 30 August 2018 12:15:59 -0400 (0:00:00.508) 0:02:19.100 ******* >2018-08-30 12:15:59,695 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:15:59,716 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:15:59,716 p=14044 u=mistral | Thursday 30 August 2018 12:15:59 -0400 (0:00:00.395) 0:02:19.496 ******* >2018-08-30 12:15:59,780 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:15:59,794 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:15:59,795 p=14044 u=mistral | Thursday 30 August 2018 12:15:59 -0400 (0:00:00.078) 0:02:19.574 ******* >2018-08-30 12:15:59,831 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:59,847 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:15:59,848 p=14044 u=mistral | Thursday 30 August 2018 12:15:59 -0400 (0:00:00.052) 0:02:19.627 ******* >2018-08-30 12:15:59,880 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:59,895 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:15:59,895 p=14044 u=mistral | Thursday 30 August 2018 12:15:59 -0400 (0:00:00.047) 0:02:19.674 ******* >2018-08-30 12:15:59,924 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:59,938 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:15:59,939 p=14044 u=mistral | Thursday 30 August 2018 12:15:59 -0400 (0:00:00.043) 0:02:19.718 ******* >2018-08-30 12:15:59,967 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:15:59,982 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:15:59,982 p=14044 u=mistral | Thursday 30 August 2018 12:15:59 -0400 (0:00:00.043) 0:02:19.762 ******* >2018-08-30 12:16:00,019 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:00,033 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:16:00,033 p=14044 u=mistral | Thursday 30 August 2018 12:16:00 -0400 (0:00:00.050) 0:02:19.812 ******* >2018-08-30 12:16:00,061 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:00,077 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:16:00,077 p=14044 u=mistral | Thursday 30 August 2018 12:16:00 -0400 (0:00:00.043) 0:02:19.856 ******* >2018-08-30 12:16:00,104 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:00,128 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:16:00,128 p=14044 u=mistral | Thursday 30 August 2018 12:16:00 -0400 (0:00:00.051) 0:02:19.907 ******* >2018-08-30 12:16:00,170 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:00,184 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:16:00,185 p=14044 u=mistral | Thursday 30 August 2018 12:16:00 -0400 (0:00:00.056) 0:02:19.964 ******* >2018-08-30 12:16:00,214 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:00,229 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:16:00,229 p=14044 u=mistral | Thursday 30 August 2018 12:16:00 -0400 (0:00:00.044) 0:02:20.008 ******* >2018-08-30 12:16:00,262 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:00,278 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:16:00,278 p=14044 u=mistral | Thursday 30 August 2018 12:16:00 -0400 (0:00:00.048) 0:02:20.057 ******* >2018-08-30 12:16:00,308 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:00,321 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:16:00,321 p=14044 u=mistral | Thursday 30 August 2018 12:16:00 -0400 (0:00:00.043) 0:02:20.101 ******* >2018-08-30 12:16:01,419 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:01,433 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:16:01,434 p=14044 u=mistral | Thursday 30 August 2018 12:16:01 -0400 (0:00:01.112) 0:02:21.213 ******* >2018-08-30 12:16:01,499 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:01,513 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:16:01,514 p=14044 u=mistral | Thursday 30 August 2018 12:16:01 -0400 (0:00:00.079) 0:02:21.293 ******* >2018-08-30 12:16:01,546 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:01,560 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:16:01,560 p=14044 u=mistral | Thursday 30 August 2018 12:16:01 -0400 (0:00:00.046) 0:02:21.340 ******* >2018-08-30 12:16:01,593 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:01,607 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:16:01,608 p=14044 u=mistral | Thursday 30 August 2018 12:16:01 -0400 (0:00:00.047) 0:02:21.387 ******* >2018-08-30 12:16:01,682 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:01,699 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:16:01,699 p=14044 u=mistral | Thursday 30 August 2018 12:16:01 -0400 (0:00:00.091) 0:02:21.478 ******* >2018-08-30 12:16:01,734 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:01,749 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:16:01,749 p=14044 u=mistral | Thursday 30 August 2018 12:16:01 -0400 (0:00:00.049) 0:02:21.528 ******* >2018-08-30 12:16:01,780 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:01,795 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:16:01,795 p=14044 u=mistral | Thursday 30 August 2018 12:16:01 -0400 (0:00:00.046) 0:02:21.574 ******* >2018-08-30 12:16:02,139 p=14044 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:16:02,428 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:16:02,718 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:16:03,013 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:16:03,479 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:16:03,500 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:16:03,501 p=14044 u=mistral | Thursday 30 August 2018 12:16:03 -0400 (0:00:01.705) 0:02:23.280 ******* >2018-08-30 12:16:03,534 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:03,553 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:16:03,554 p=14044 u=mistral | Thursday 30 August 2018 12:16:03 -0400 (0:00:00.052) 0:02:23.333 ******* >2018-08-30 12:16:03,585 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:03,611 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:16:03,611 p=14044 u=mistral | Thursday 30 August 2018 12:16:03 -0400 (0:00:00.057) 0:02:23.390 ******* >2018-08-30 12:16:03,874 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:16:03,900 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:16:03,901 p=14044 u=mistral | Thursday 30 August 2018 12:16:03 -0400 (0:00:00.289) 0:02:23.680 ******* >2018-08-30 12:16:03,933 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:03,954 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:16:03,955 p=14044 u=mistral | Thursday 30 August 2018 12:16:03 -0400 (0:00:00.053) 0:02:23.734 ******* >2018-08-30 12:16:03,987 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:04,003 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:16:04,003 p=14044 u=mistral | Thursday 30 August 2018 12:16:04 -0400 (0:00:00.048) 0:02:23.782 ******* >2018-08-30 12:16:04,354 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:16:04,376 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:16:04,376 p=14044 u=mistral | Thursday 30 August 2018 12:16:04 -0400 (0:00:00.372) 0:02:24.155 ******* >2018-08-30 12:16:06,974 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:16:06,987 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:16:06,987 p=14044 u=mistral | Thursday 30 August 2018 12:16:06 -0400 (0:00:02.610) 0:02:26.766 ******* >2018-08-30 12:16:07,022 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,036 p=14044 u=mistral | TASK [ceph-mon : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:16:07,036 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.049) 0:02:26.815 ******* >2018-08-30 12:16:07,100 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:07,116 p=14044 u=mistral | TASK [ceph-mon : make sure monitor_interface or monitor_address or monitor_address_block is configured] *** >2018-08-30 12:16:07,116 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.079) 0:02:26.895 ******* >2018-08-30 12:16:07,152 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,172 p=14044 u=mistral | TASK [ceph-mon : generate monitor initial keyring] ***************************** >2018-08-30 12:16:07,173 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.056) 0:02:26.952 ******* >2018-08-30 12:16:07,203 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,226 p=14044 u=mistral | TASK [ceph-mon : read monitor initial keyring if it already exists] ************ >2018-08-30 12:16:07,226 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.053) 0:02:27.005 ******* >2018-08-30 12:16:07,253 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,269 p=14044 u=mistral | TASK [ceph-mon : create monitor initial keyring] ******************************* >2018-08-30 12:16:07,269 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.042) 0:02:27.048 ******* >2018-08-30 12:16:07,302 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,316 p=14044 u=mistral | TASK [ceph-mon : set initial monitor key permissions] ************************** >2018-08-30 12:16:07,316 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.046) 0:02:27.095 ******* >2018-08-30 12:16:07,349 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,366 p=14044 u=mistral | TASK [ceph-mon : create (and fix ownership of) monitor directory] ************** >2018-08-30 12:16:07,366 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.050) 0:02:27.145 ******* >2018-08-30 12:16:07,397 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,412 p=14044 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap >= ceph_release_num.luminous] *** >2018-08-30 12:16:07,412 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.045) 0:02:27.191 ******* >2018-08-30 12:16:07,437 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,450 p=14044 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap < ceph_release_num.luminous] *** >2018-08-30 12:16:07,450 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.038) 0:02:27.229 ******* >2018-08-30 12:16:07,477 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,490 p=14044 u=mistral | TASK [ceph-mon : create custom admin keyring] ********************************** >2018-08-30 12:16:07,491 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.040) 0:02:27.270 ******* >2018-08-30 12:16:07,517 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,532 p=14044 u=mistral | TASK [ceph-mon : set ownership of admin keyring] ******************************* >2018-08-30 12:16:07,532 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.041) 0:02:27.311 ******* >2018-08-30 12:16:07,559 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,575 p=14044 u=mistral | TASK [ceph-mon : import admin keyring into mon keyring] ************************ >2018-08-30 12:16:07,575 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.042) 0:02:27.354 ******* >2018-08-30 12:16:07,600 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,613 p=14044 u=mistral | TASK [ceph-mon : ceph monitor mkfs with keyring] ******************************* >2018-08-30 12:16:07,614 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.038) 0:02:27.393 ******* >2018-08-30 12:16:07,638 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,652 p=14044 u=mistral | TASK [ceph-mon : ceph monitor mkfs without keyring] **************************** >2018-08-30 12:16:07,653 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.039) 0:02:27.432 ******* >2018-08-30 12:16:07,680 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,694 p=14044 u=mistral | TASK [ceph-mon : ensure systemd service override directory exists] ************* >2018-08-30 12:16:07,695 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.041) 0:02:27.474 ******* >2018-08-30 12:16:07,722 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,736 p=14044 u=mistral | TASK [ceph-mon : add ceph-mon systemd service overrides] *********************** >2018-08-30 12:16:07,737 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.041) 0:02:27.516 ******* >2018-08-30 12:16:07,766 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,779 p=14044 u=mistral | TASK [ceph-mon : start the monitor service] ************************************ >2018-08-30 12:16:07,779 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.042) 0:02:27.559 ******* >2018-08-30 12:16:07,804 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,819 p=14044 u=mistral | TASK [ceph-mon : enable the ceph-mon.target service] *************************** >2018-08-30 12:16:07,820 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.040) 0:02:27.599 ******* >2018-08-30 12:16:07,849 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,864 p=14044 u=mistral | TASK [ceph-mon : include ceph_keys.yml] **************************************** >2018-08-30 12:16:07,864 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.043) 0:02:27.643 ******* >2018-08-30 12:16:07,900 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,914 p=14044 u=mistral | TASK [ceph-mon : collect all the pools] **************************************** >2018-08-30 12:16:07,914 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.050) 0:02:27.694 ******* >2018-08-30 12:16:07,940 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:07,962 p=14044 u=mistral | TASK [ceph-mon : secure the cluster] ******************************************* >2018-08-30 12:16:07,963 p=14044 u=mistral | Thursday 30 August 2018 12:16:07 -0400 (0:00:00.048) 0:02:27.742 ******* >2018-08-30 12:16:08,016 p=14044 u=mistral | TASK [ceph-mon : set_fact ceph_config_keys] ************************************ >2018-08-30 12:16:08,016 p=14044 u=mistral | Thursday 30 August 2018 12:16:08 -0400 (0:00:00.053) 0:02:27.795 ******* >2018-08-30 12:16:08,089 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:08,104 p=14044 u=mistral | TASK [ceph-mon : register rbd bootstrap key] *********************************** >2018-08-30 12:16:08,105 p=14044 u=mistral | Thursday 30 August 2018 12:16:08 -0400 (0:00:00.088) 0:02:27.884 ******* >2018-08-30 12:16:08,178 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:08,191 p=14044 u=mistral | TASK [ceph-mon : merge rbd bootstrap key to config and keys paths] ************* >2018-08-30 12:16:08,192 p=14044 u=mistral | Thursday 30 August 2018 12:16:08 -0400 (0:00:00.086) 0:02:27.971 ******* >2018-08-30 12:16:08,264 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:08,301 p=14044 u=mistral | TASK [ceph-mon : stat for ceph config and keys] ******************************** >2018-08-30 12:16:08,301 p=14044 u=mistral | Thursday 30 August 2018 12:16:08 -0400 (0:00:00.109) 0:02:28.081 ******* >2018-08-30 12:16:08,552 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:16:08,774 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:16:08,995 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:16:09,216 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:16:09,451 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:16:09,656 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:16:09,679 p=14044 u=mistral | TASK [ceph-mon : try to copy ceph keys] **************************************** >2018-08-30 12:16:09,679 p=14044 u=mistral | Thursday 30 August 2018 12:16:09 -0400 (0:00:01.377) 0:02:29.458 ******* >2018-08-30 12:16:10,426 p=14044 u=mistral | ok: [172.16.0.24] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:10,451 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:11,132 p=14044 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:11,856 p=14044 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:12,549 p=14044 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:12,579 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:12,602 p=14044 u=mistral | TASK [ceph-mon : populate kv_store with default ceph.conf] ********************* >2018-08-30 12:16:12,602 p=14044 u=mistral | Thursday 30 August 2018 12:16:12 -0400 (0:00:02.922) 0:02:32.381 ******* >2018-08-30 12:16:12,632 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:16:12,642 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:12,656 p=14044 u=mistral | TASK [ceph-mon : populate kv_store with custom ceph.conf] ********************** >2018-08-30 12:16:12,656 p=14044 u=mistral | Thursday 30 August 2018 12:16:12 -0400 (0:00:00.053) 0:02:32.435 ******* >2018-08-30 12:16:12,684 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:16:12,692 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:12,706 p=14044 u=mistral | TASK [ceph-mon : delete populate-kv-store docker] ****************************** >2018-08-30 12:16:12,706 p=14044 u=mistral | Thursday 30 August 2018 12:16:12 -0400 (0:00:00.049) 0:02:32.485 ******* >2018-08-30 12:16:12,736 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:12,749 p=14044 u=mistral | TASK [ceph-mon : generate systemd unit file] *********************************** >2018-08-30 12:16:12,749 p=14044 u=mistral | Thursday 30 August 2018 12:16:12 -0400 (0:00:00.043) 0:02:32.528 ******* >2018-08-30 12:16:13,658 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:13,673 p=14044 u=mistral | TASK [ceph-mon : systemd start mon container] ********************************** >2018-08-30 12:16:13,673 p=14044 u=mistral | Thursday 30 August 2018 12:16:13 -0400 (0:00:00.923) 0:02:33.452 ******* >2018-08-30 12:16:14,210 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:14,228 p=14044 u=mistral | TASK [ceph-mon : configure ceph profile.d aliases] ***************************** >2018-08-30 12:16:14,228 p=14044 u=mistral | Thursday 30 August 2018 12:16:14 -0400 (0:00:00.555) 0:02:34.007 ******* >2018-08-30 12:16:15,055 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:15,069 p=14044 u=mistral | TASK [ceph-mon : wait for monitor socket to exist] ***************************** >2018-08-30 12:16:15,069 p=14044 u=mistral | Thursday 30 August 2018 12:16:15 -0400 (0:00:00.841) 0:02:34.848 ******* >2018-08-30 12:16:15,569 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:16:15,584 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:16:15,584 p=14044 u=mistral | Thursday 30 August 2018 12:16:15 -0400 (0:00:00.515) 0:02:35.363 ******* >2018-08-30 12:16:15,666 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:15,690 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:16:15,690 p=14044 u=mistral | Thursday 30 August 2018 12:16:15 -0400 (0:00:00.106) 0:02:35.470 ******* >2018-08-30 12:16:15,759 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:15,774 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:16:15,774 p=14044 u=mistral | Thursday 30 August 2018 12:16:15 -0400 (0:00:00.083) 0:02:35.553 ******* >2018-08-30 12:16:16,413 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:16,428 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:16:16,428 p=14044 u=mistral | Thursday 30 August 2018 12:16:16 -0400 (0:00:00.653) 0:02:36.207 ******* >2018-08-30 12:16:16,462 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:16,476 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:16:16,477 p=14044 u=mistral | Thursday 30 August 2018 12:16:16 -0400 (0:00:00.048) 0:02:36.256 ******* >2018-08-30 12:16:16,510 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:16,527 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:16:16,527 p=14044 u=mistral | Thursday 30 August 2018 12:16:16 -0400 (0:00:00.050) 0:02:36.307 ******* >2018-08-30 12:16:16,558 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:16,574 p=14044 u=mistral | TASK [ceph-mon : push ceph files to the ansible server] ************************ >2018-08-30 12:16:16,575 p=14044 u=mistral | Thursday 30 August 2018 12:16:16 -0400 (0:00:00.047) 0:02:36.354 ******* >2018-08-30 12:16:16,644 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:16,938 p=14044 u=mistral | ok: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:16,973 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:17,006 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:17,036 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:17,337 p=14044 u=mistral | ok: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:16:17,365 p=14044 u=mistral | TASK [ceph-mon : create ceph rest api keyring when mon is containerized] ******* >2018-08-30 12:16:17,365 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.790) 0:02:37.145 ******* >2018-08-30 12:16:17,399 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:17,416 p=14044 u=mistral | TASK [ceph-mon : create ceph mgr keyring(s) when mon is containerized] ********* >2018-08-30 12:16:17,416 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.050) 0:02:37.196 ******* >2018-08-30 12:16:17,458 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:17,466 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:17,476 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:17,493 p=14044 u=mistral | TASK [ceph-mon : stat for ceph mgr key(s)] ************************************* >2018-08-30 12:16:17,494 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.077) 0:02:37.273 ******* >2018-08-30 12:16:17,530 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:17,539 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:17,548 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:17,566 p=14044 u=mistral | TASK [ceph-mon : fetch ceph mgr key(s)] **************************************** >2018-08-30 12:16:17,567 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.072) 0:02:37.346 ******* >2018-08-30 12:16:17,606 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.33', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:16:17,614 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.24', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:16:17,626 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.25', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:16:17,644 p=14044 u=mistral | TASK [ceph-mon : configure crush hierarchy] ************************************ >2018-08-30 12:16:17,645 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.078) 0:02:37.424 ******* >2018-08-30 12:16:17,680 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.28) >2018-08-30 12:16:17,686 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.36) >2018-08-30 12:16:17,693 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.32) >2018-08-30 12:16:17,708 p=14044 u=mistral | TASK [ceph-mon : create configured crush rules] ******************************** >2018-08-30 12:16:17,709 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.063) 0:02:37.488 ******* >2018-08-30 12:16:17,749 p=14044 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:16:17,753 p=14044 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:16:17,769 p=14044 u=mistral | TASK [ceph-mon : get id for new default crush rule] **************************** >2018-08-30 12:16:17,769 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.060) 0:02:37.548 ******* >2018-08-30 12:16:17,812 p=14044 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:16:17,814 p=14044 u=mistral | skipping: [172.16.0.24] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:16:17,830 p=14044 u=mistral | TASK [ceph-mon : set_fact info_ceph_default_crush_rule_yaml] ******************* >2018-08-30 12:16:17,831 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.061) 0:02:37.610 ******* >2018-08-30 12:16:17,865 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'HDD', u'name': u'HDD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:16:17,872 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'SSD', u'name': u'SSD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:16:17,887 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_crush_rule to osd_pool_default_crush_replicated_ruleset if release < luminous else osd_pool_default_crush_rule] *** >2018-08-30 12:16:17,888 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.056) 0:02:37.667 ******* >2018-08-30 12:16:17,917 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:17,980 p=14044 u=mistral | TASK [ceph-mon : insert new default crush rule into daemon to prevent restart] *** >2018-08-30 12:16:17,980 p=14044 u=mistral | Thursday 30 August 2018 12:16:17 -0400 (0:00:00.092) 0:02:37.759 ******* >2018-08-30 12:16:18,015 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:18,022 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:18,028 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:18,100 p=14044 u=mistral | TASK [ceph-mon : add new default crush rule to ceph.conf] ********************** >2018-08-30 12:16:18,101 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.120) 0:02:37.880 ******* >2018-08-30 12:16:18,141 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:18,144 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:18,150 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:18,169 p=14044 u=mistral | TASK [ceph-mon : get default value for osd_pool_default_pg_num] **************** >2018-08-30 12:16:18,170 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.068) 0:02:37.949 ******* >2018-08-30 12:16:18,205 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:18,222 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with pool_default_pg_num (backward compatibility)] *** >2018-08-30 12:16:18,223 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.053) 0:02:38.002 ******* >2018-08-30 12:16:18,253 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:18,269 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with default_pool_default_pg_num.stdout] *** >2018-08-30 12:16:18,270 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.046) 0:02:38.049 ******* >2018-08-30 12:16:18,302 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:18,317 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num ceph_conf_overrides.global.osd_pool_default_pg_num] *** >2018-08-30 12:16:18,318 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.047) 0:02:38.097 ******* >2018-08-30 12:16:18,387 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:18,400 p=14044 u=mistral | TASK [ceph-mon : increase calamari logging level when debug is on] ************* >2018-08-30 12:16:18,401 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.083) 0:02:38.180 ******* >2018-08-30 12:16:18,435 p=14044 u=mistral | skipping: [172.16.0.24] => (item=cthulhu) >2018-08-30 12:16:18,439 p=14044 u=mistral | skipping: [172.16.0.24] => (item=calamari_web) >2018-08-30 12:16:18,453 p=14044 u=mistral | TASK [ceph-mon : initialize the calamari server api] *************************** >2018-08-30 12:16:18,454 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.052) 0:02:38.233 ******* >2018-08-30 12:16:18,478 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:18,480 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:16:18,480 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.026) 0:02:38.259 ******* >2018-08-30 12:16:18,555 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:18,556 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:16:18,557 p=14044 u=mistral | Thursday 30 August 2018 12:16:18 -0400 (0:00:00.076) 0:02:38.336 ******* >2018-08-30 12:16:19,270 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:19,271 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:16:19,272 p=14044 u=mistral | Thursday 30 August 2018 12:16:19 -0400 (0:00:00.715) 0:02:39.051 ******* >2018-08-30 12:16:19,363 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:19,371 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:19,380 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:19,382 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:16:19,382 p=14044 u=mistral | Thursday 30 August 2018 12:16:19 -0400 (0:00:00.110) 0:02:39.161 ******* >2018-08-30 12:16:19,499 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:30,976 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:31,012 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:31,014 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:16:31,015 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:11.632) 0:02:50.794 ******* >2018-08-30 12:16:31,089 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:31,090 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:16:31,090 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.075) 0:02:50.869 ******* >2018-08-30 12:16:31,165 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:31,166 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:16:31,166 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.075) 0:02:50.945 ******* >2018-08-30 12:16:31,211 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:31,212 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:16:31,213 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.046) 0:02:50.992 ******* >2018-08-30 12:16:31,307 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.28) >2018-08-30 12:16:31,316 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.36) >2018-08-30 12:16:31,323 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.32) >2018-08-30 12:16:31,325 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:16:31,325 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.112) 0:02:51.104 ******* >2018-08-30 12:16:31,421 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.28) >2018-08-30 12:16:31,432 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.36) >2018-08-30 12:16:31,441 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.32) >2018-08-30 12:16:31,443 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:16:31,443 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.117) 0:02:51.222 ******* >2018-08-30 12:16:31,514 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:31,515 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:16:31,516 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.072) 0:02:51.295 ******* >2018-08-30 12:16:31,593 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:31,594 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:16:31,595 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.078) 0:02:51.374 ******* >2018-08-30 12:16:31,640 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:31,641 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:16:31,641 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.046) 0:02:51.420 ******* >2018-08-30 12:16:31,688 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:16:31,689 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.047) 0:02:51.468 ******* >2018-08-30 12:16:31,734 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:16:31,734 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.045) 0:02:51.514 ******* >2018-08-30 12:16:31,813 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:31,814 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:16:31,815 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.080) 0:02:51.594 ******* >2018-08-30 12:16:31,886 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:31,887 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:16:31,887 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.072) 0:02:51.666 ******* >2018-08-30 12:16:31,927 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:31,928 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:16:31,928 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.041) 0:02:51.707 ******* >2018-08-30 12:16:31,970 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:16:31,970 p=14044 u=mistral | Thursday 30 August 2018 12:16:31 -0400 (0:00:00.041) 0:02:51.749 ******* >2018-08-30 12:16:32,013 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:16:32,014 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.043) 0:02:51.793 ******* >2018-08-30 12:16:32,083 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:32,084 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:16:32,084 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.070) 0:02:51.863 ******* >2018-08-30 12:16:32,165 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:32,166 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:16:32,166 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.081) 0:02:51.945 ******* >2018-08-30 12:16:32,216 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:32,218 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:16:32,218 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.051) 0:02:51.997 ******* >2018-08-30 12:16:32,266 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:16:32,267 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.048) 0:02:52.046 ******* >2018-08-30 12:16:32,313 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:16:32,314 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.046) 0:02:52.093 ******* >2018-08-30 12:16:32,387 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:32,388 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:16:32,389 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.074) 0:02:52.168 ******* >2018-08-30 12:16:32,463 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:32,464 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:16:32,464 p=14044 u=mistral | Thursday 30 August 2018 12:16:32 -0400 (0:00:00.075) 0:02:52.244 ******* >2018-08-30 12:16:33,180 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:33,181 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:16:33,181 p=14044 u=mistral | Thursday 30 August 2018 12:16:33 -0400 (0:00:00.716) 0:02:52.960 ******* >2018-08-30 12:16:33,270 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:33,278 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:33,288 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:33,290 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:16:33,290 p=14044 u=mistral | Thursday 30 August 2018 12:16:33 -0400 (0:00:00.108) 0:02:53.069 ******* >2018-08-30 12:16:33,429 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:44,256 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:44,291 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:44,293 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:16:44,294 p=14044 u=mistral | Thursday 30 August 2018 12:16:44 -0400 (0:00:11.003) 0:03:04.073 ******* >2018-08-30 12:16:44,368 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:44,384 p=14044 u=mistral | TASK [start ceph mon] ********************************************************** >2018-08-30 12:16:44,385 p=14044 u=mistral | Thursday 30 August 2018 12:16:44 -0400 (0:00:00.090) 0:03:04.164 ******* >2018-08-30 12:16:44,414 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:44,429 p=14044 u=mistral | TASK [restart containerized ceph mon] ****************************************** >2018-08-30 12:16:44,429 p=14044 u=mistral | Thursday 30 August 2018 12:16:44 -0400 (0:00:00.044) 0:03:04.209 ******* >2018-08-30 12:16:45,455 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:16:45,471 p=14044 u=mistral | TASK [set mon_host_count] ****************************************************** >2018-08-30 12:16:45,471 p=14044 u=mistral | Thursday 30 August 2018 12:16:45 -0400 (0:00:01.041) 0:03:05.250 ******* >2018-08-30 12:16:45,537 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:16:45,551 p=14044 u=mistral | TASK [select a running monitor if multiple monitors] *************************** >2018-08-30 12:16:45,551 p=14044 u=mistral | Thursday 30 August 2018 12:16:45 -0400 (0:00:00.080) 0:03:05.330 ******* >2018-08-30 12:16:45,619 p=14044 u=mistral | ok: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:45,626 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:16:45,654 p=14044 u=mistral | ok: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:16:45,671 p=14044 u=mistral | TASK [select first monitor if only one monitor] ******************************** >2018-08-30 12:16:45,672 p=14044 u=mistral | Thursday 30 August 2018 12:16:45 -0400 (0:00:00.120) 0:03:05.451 ******* >2018-08-30 12:16:45,701 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:16:45,726 p=14044 u=mistral | TASK [non container | waiting for the monitor to join the quorum...] *********** >2018-08-30 12:16:45,726 p=14044 u=mistral | Thursday 30 August 2018 12:16:45 -0400 (0:00:00.054) 0:03:05.505 ******* >2018-08-30 12:16:45,758 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:16:45,787 p=14044 u=mistral | TASK [container | waiting for the containerized monitor to join the quorum...] *** >2018-08-30 12:16:45,787 p=14044 u=mistral | Thursday 30 August 2018 12:16:45 -0400 (0:00:00.061) 0:03:05.566 ******* >2018-08-30 12:16:46,757 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.25] >2018-08-30 12:16:46,786 p=14044 u=mistral | TASK [set osd flags] *********************************************************** >2018-08-30 12:16:46,786 p=14044 u=mistral | Thursday 30 August 2018 12:16:46 -0400 (0:00:00.999) 0:03:06.566 ******* >2018-08-30 12:16:46,819 p=14044 u=mistral | skipping: [172.16.0.24] => (item=noout) >2018-08-30 12:16:46,824 p=14044 u=mistral | skipping: [172.16.0.24] => (item=noscrub) >2018-08-30 12:16:46,830 p=14044 u=mistral | skipping: [172.16.0.24] => (item=nodeep-scrub) >2018-08-30 12:16:46,860 p=14044 u=mistral | TASK [set containerized osd flags] ********************************************* >2018-08-30 12:16:46,861 p=14044 u=mistral | Thursday 30 August 2018 12:16:46 -0400 (0:00:00.074) 0:03:06.640 ******* >2018-08-30 12:16:53,354 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.25] => (item=noout) >2018-08-30 12:16:55,136 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.25] => (item=noscrub) >2018-08-30 12:16:56,494 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.25] => (item=nodeep-scrub) >2018-08-30 12:16:56,514 p=14044 u=mistral | PLAY [upgrade ceph mon cluster] ************************************************ >2018-08-30 12:16:56,666 p=14044 u=mistral | TASK [set mon_host_count] ****************************************************** >2018-08-30 12:16:56,666 p=14044 u=mistral | Thursday 30 August 2018 12:16:56 -0400 (0:00:09.805) 0:03:16.445 ******* >2018-08-30 12:16:56,738 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:16:56,754 p=14044 u=mistral | TASK [debug] ******************************************************************* >2018-08-30 12:16:56,755 p=14044 u=mistral | Thursday 30 August 2018 12:16:56 -0400 (0:00:00.088) 0:03:16.534 ******* >2018-08-30 12:16:56,785 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:56,800 p=14044 u=mistral | TASK [fail when single containerized monitor] ********************************** >2018-08-30 12:16:56,800 p=14044 u=mistral | Thursday 30 August 2018 12:16:56 -0400 (0:00:00.045) 0:03:16.580 ******* >2018-08-30 12:16:56,826 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:56,843 p=14044 u=mistral | TASK [stop ceph mon] *********************************************************** >2018-08-30 12:16:56,843 p=14044 u=mistral | Thursday 30 August 2018 12:16:56 -0400 (0:00:00.042) 0:03:16.622 ******* >2018-08-30 12:16:56,868 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:56,884 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:16:56,884 p=14044 u=mistral | Thursday 30 August 2018 12:16:56 -0400 (0:00:00.040) 0:03:16.663 ******* >2018-08-30 12:16:57,254 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:16:57,271 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:16:57,271 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.387) 0:03:17.051 ******* >2018-08-30 12:16:57,303 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:57,319 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:16:57,319 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.047) 0:03:17.098 ******* >2018-08-30 12:16:57,350 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:57,365 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:16:57,366 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.046) 0:03:17.145 ******* >2018-08-30 12:16:57,396 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:57,412 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:16:57,412 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.046) 0:03:17.191 ******* >2018-08-30 12:16:57,808 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:16:57,822 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:16:57,823 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.410) 0:03:17.602 ******* >2018-08-30 12:16:57,852 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:57,867 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:16:57,867 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.044) 0:03:17.646 ******* >2018-08-30 12:16:57,899 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:57,915 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:16:57,915 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.047) 0:03:17.694 ******* >2018-08-30 12:16:57,945 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:57,969 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:16:57,969 p=14044 u=mistral | Thursday 30 August 2018 12:16:57 -0400 (0:00:00.054) 0:03:17.748 ******* >2018-08-30 12:16:58,003 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,017 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:16:58,017 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.048) 0:03:17.797 ******* >2018-08-30 12:16:58,045 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,059 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:16:58,060 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.042) 0:03:17.839 ******* >2018-08-30 12:16:58,089 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,106 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:16:58,106 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.046) 0:03:17.885 ******* >2018-08-30 12:16:58,133 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,149 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:16:58,149 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.042) 0:03:17.928 ******* >2018-08-30 12:16:58,186 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,201 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:16:58,201 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.052) 0:03:17.981 ******* >2018-08-30 12:16:58,237 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,253 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:16:58,253 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.051) 0:03:18.032 ******* >2018-08-30 12:16:58,285 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,301 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:16:58,301 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.048) 0:03:18.080 ******* >2018-08-30 12:16:58,335 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,353 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:16:58,353 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.051) 0:03:18.132 ******* >2018-08-30 12:16:58,383 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,398 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:16:58,398 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.045) 0:03:18.178 ******* >2018-08-30 12:16:58,430 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,444 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:16:58,444 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.045) 0:03:18.223 ******* >2018-08-30 12:16:58,474 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,490 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:16:58,490 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.046) 0:03:18.269 ******* >2018-08-30 12:16:58,520 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,535 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:16:58,535 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.045) 0:03:18.314 ******* >2018-08-30 12:16:58,565 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,581 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:16:58,581 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.045) 0:03:18.360 ******* >2018-08-30 12:16:58,611 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,630 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:16:58,631 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.049) 0:03:18.410 ******* >2018-08-30 12:16:58,659 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,675 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:16:58,676 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.045) 0:03:18.455 ******* >2018-08-30 12:16:58,703 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,723 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:16:58,723 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.047) 0:03:18.502 ******* >2018-08-30 12:16:58,756 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,783 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:16:58,783 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.060) 0:03:18.563 ******* >2018-08-30 12:16:58,815 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,832 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:16:58,832 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.048) 0:03:18.611 ******* >2018-08-30 12:16:58,865 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,879 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:16:58,879 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.046) 0:03:18.658 ******* >2018-08-30 12:16:58,906 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:58,920 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:16:58,921 p=14044 u=mistral | Thursday 30 August 2018 12:16:58 -0400 (0:00:00.041) 0:03:18.700 ******* >2018-08-30 12:16:59,256 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:16:59,276 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:16:59,277 p=14044 u=mistral | Thursday 30 August 2018 12:16:59 -0400 (0:00:00.355) 0:03:19.056 ******* >2018-08-30 12:16:59,341 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:16:59,359 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:16:59,359 p=14044 u=mistral | Thursday 30 August 2018 12:16:59 -0400 (0:00:00.082) 0:03:19.138 ******* >2018-08-30 12:16:59,418 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:16:59,433 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:16:59,433 p=14044 u=mistral | Thursday 30 August 2018 12:16:59 -0400 (0:00:00.073) 0:03:19.212 ******* >2018-08-30 12:16:59,458 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:59,486 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:16:59,487 p=14044 u=mistral | Thursday 30 August 2018 12:16:59 -0400 (0:00:00.053) 0:03:19.266 ******* >2018-08-30 12:16:59,587 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:16:59,618 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:16:59,618 p=14044 u=mistral | Thursday 30 August 2018 12:16:59 -0400 (0:00:00.131) 0:03:19.398 ******* >2018-08-30 12:16:59,651 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:16:59,677 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:16:59,678 p=14044 u=mistral | Thursday 30 August 2018 12:16:59 -0400 (0:00:00.059) 0:03:19.457 ******* >2018-08-30 12:16:59,927 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:16:59,942 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:16:59,942 p=14044 u=mistral | Thursday 30 August 2018 12:16:59 -0400 (0:00:00.264) 0:03:19.722 ******* >2018-08-30 12:17:00,032 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:00,054 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:17:00,054 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.111) 0:03:19.833 ******* >2018-08-30 12:17:00,320 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:17:00,336 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:17:00,336 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.282) 0:03:20.115 ******* >2018-08-30 12:17:00,366 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:00,383 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:17:00,383 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.046) 0:03:20.162 ******* >2018-08-30 12:17:00,457 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:00,482 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:17:00,482 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.099) 0:03:20.262 ******* >2018-08-30 12:17:00,507 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:00,530 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:17:00,530 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.047) 0:03:20.309 ******* >2018-08-30 12:17:00,563 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:00,587 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:17:00,587 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.057) 0:03:20.366 ******* >2018-08-30 12:17:00,612 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:00,633 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:17:00,633 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.046) 0:03:20.412 ******* >2018-08-30 12:17:00,657 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:00,671 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:17:00,671 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.038) 0:03:20.451 ******* >2018-08-30 12:17:00,737 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:00,752 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:17:00,752 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.080) 0:03:20.531 ******* >2018-08-30 12:17:00,782 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:00,805 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:17:00,805 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.053) 0:03:20.585 ******* >2018-08-30 12:17:00,873 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:00,889 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:17:00,890 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.084) 0:03:20.669 ******* >2018-08-30 12:17:00,952 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:00,968 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:17:00,968 p=14044 u=mistral | Thursday 30 August 2018 12:17:00 -0400 (0:00:00.078) 0:03:20.747 ******* >2018-08-30 12:17:01,038 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:01,054 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:17:01,055 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.086) 0:03:20.834 ******* >2018-08-30 12:17:01,095 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/dev/vdb) >2018-08-30 12:17:01,111 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:17:01,112 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.056) 0:03:20.891 ******* >2018-08-30 12:17:01,148 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:17:01,163 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:17:01,163 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.051) 0:03:20.942 ******* >2018-08-30 12:17:01,193 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:01,211 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:17:01,212 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.048) 0:03:20.991 ******* >2018-08-30 12:17:01,239 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:01,254 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:17:01,255 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.043) 0:03:21.034 ******* >2018-08-30 12:17:01,280 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:01,299 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:17:01,300 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.044) 0:03:21.079 ******* >2018-08-30 12:17:01,329 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:01,348 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:17:01,348 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.048) 0:03:21.127 ******* >2018-08-30 12:17:01,377 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:01,391 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:17:01,391 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.043) 0:03:21.170 ******* >2018-08-30 12:17:01,449 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:01,467 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:17:01,467 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.075) 0:03:21.246 ******* >2018-08-30 12:17:01,520 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:01,535 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:17:01,535 p=14044 u=mistral | Thursday 30 August 2018 12:17:01 -0400 (0:00:00.067) 0:03:21.314 ******* >2018-08-30 12:17:01,894 p=14044 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:17:02,203 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/) >2018-08-30 12:17:02,494 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mon) >2018-08-30 12:17:02,768 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/osd) >2018-08-30 12:17:03,248 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mds) >2018-08-30 12:17:03,559 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/tmp) >2018-08-30 12:17:03,883 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:17:04,237 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:17:04,551 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:17:04,843 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:17:05,138 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:17:05,451 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:17:05,470 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:17:05,470 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:03.935) 0:03:25.249 ******* >2018-08-30 12:17:05,497 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,510 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:17:05,510 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.040) 0:03:25.290 ******* >2018-08-30 12:17:05,535 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,549 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:17:05,549 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.038) 0:03:25.328 ******* >2018-08-30 12:17:05,575 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,588 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:17:05,588 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.039) 0:03:25.368 ******* >2018-08-30 12:17:05,617 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,631 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:17:05,631 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.042) 0:03:25.410 ******* >2018-08-30 12:17:05,658 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,671 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:17:05,671 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.040) 0:03:25.450 ******* >2018-08-30 12:17:05,698 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,711 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:17:05,711 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.039) 0:03:25.490 ******* >2018-08-30 12:17:05,741 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,755 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:17:05,755 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.043) 0:03:25.534 ******* >2018-08-30 12:17:05,782 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,798 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:17:05,799 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.043) 0:03:25.578 ******* >2018-08-30 12:17:05,825 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,838 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:17:05,839 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.039) 0:03:25.618 ******* >2018-08-30 12:17:05,861 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,875 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:17:05,875 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.036) 0:03:25.654 ******* >2018-08-30 12:17:05,899 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,913 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:17:05,913 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.038) 0:03:25.692 ******* >2018-08-30 12:17:05,937 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,950 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:17:05,951 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.037) 0:03:25.730 ******* >2018-08-30 12:17:05,976 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:05,990 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:17:05,990 p=14044 u=mistral | Thursday 30 August 2018 12:17:05 -0400 (0:00:00.039) 0:03:25.769 ******* >2018-08-30 12:17:06,017 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,030 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:17:06,030 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.040) 0:03:25.810 ******* >2018-08-30 12:17:06,054 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,067 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:17:06,068 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.037) 0:03:25.847 ******* >2018-08-30 12:17:06,095 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,107 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:17:06,108 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.039) 0:03:25.887 ******* >2018-08-30 12:17:06,133 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,147 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:17:06,147 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.039) 0:03:25.926 ******* >2018-08-30 12:17:06,175 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,189 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:17:06,189 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.042) 0:03:25.969 ******* >2018-08-30 12:17:06,212 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,226 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:17:06,226 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.036) 0:03:26.005 ******* >2018-08-30 12:17:06,256 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,269 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:17:06,269 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.043) 0:03:26.048 ******* >2018-08-30 12:17:06,303 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,323 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:17:06,323 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.053) 0:03:26.102 ******* >2018-08-30 12:17:06,354 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,369 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:17:06,370 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.046) 0:03:26.149 ******* >2018-08-30 12:17:06,400 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,415 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:17:06,416 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.045) 0:03:26.195 ******* >2018-08-30 12:17:06,443 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,458 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:17:06,459 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.043) 0:03:26.238 ******* >2018-08-30 12:17:06,489 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,513 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:17:06,513 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.054) 0:03:26.292 ******* >2018-08-30 12:17:06,546 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,564 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:17:06,564 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.050) 0:03:26.343 ******* >2018-08-30 12:17:06,596 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,616 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-controller02/keyring already exists] *** >2018-08-30 12:17:06,616 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.052) 0:03:26.395 ******* >2018-08-30 12:17:06,646 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,664 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-controller02/keyring doesn't exist] *** >2018-08-30 12:17:06,664 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.048) 0:03:26.444 ******* >2018-08-30 12:17:06,693 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,709 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:17:06,709 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.044) 0:03:26.489 ******* >2018-08-30 12:17:06,739 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,756 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:17:06,756 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.046) 0:03:26.535 ******* >2018-08-30 12:17:06,784 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,804 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:17:06,804 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.048) 0:03:26.584 ******* >2018-08-30 12:17:06,832 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,852 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:17:06,852 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.048) 0:03:26.632 ******* >2018-08-30 12:17:06,882 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,895 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:17:06,896 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.043) 0:03:26.675 ******* >2018-08-30 12:17:06,926 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:06,944 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:17:06,945 p=14044 u=mistral | Thursday 30 August 2018 12:17:06 -0400 (0:00:00.049) 0:03:26.724 ******* >2018-08-30 12:17:06,988 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:17:06,991 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/log/ceph) >2018-08-30 12:17:07,008 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:17:07,009 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.064) 0:03:26.788 ******* >2018-08-30 12:17:07,037 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,057 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:17:07,057 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.048) 0:03:26.836 ******* >2018-08-30 12:17:07,090 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,103 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:17:07,104 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.046) 0:03:26.883 ******* >2018-08-30 12:17:07,135 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,149 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:17:07,150 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.046) 0:03:26.929 ******* >2018-08-30 12:17:07,183 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,197 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:17:07,197 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.047) 0:03:26.976 ******* >2018-08-30 12:17:07,227 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,242 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:17:07,242 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.045) 0:03:27.022 ******* >2018-08-30 12:17:07,274 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,289 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:17:07,289 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.046) 0:03:27.069 ******* >2018-08-30 12:17:07,320 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,337 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:17:07,338 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.048) 0:03:27.117 ******* >2018-08-30 12:17:07,382 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,397 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:17:07,397 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.059) 0:03:27.176 ******* >2018-08-30 12:17:07,432 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:07,455 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:17:07,456 p=14044 u=mistral | Thursday 30 August 2018 12:17:07 -0400 (0:00:00.058) 0:03:27.235 ******* >2018-08-30 12:17:07,810 p=14044 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:17:08,127 p=14044 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:17:08,146 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:17:08,147 p=14044 u=mistral | Thursday 30 August 2018 12:17:08 -0400 (0:00:00.691) 0:03:27.926 ******* >2018-08-30 12:17:08,206 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:08,221 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:17:08,221 p=14044 u=mistral | Thursday 30 August 2018 12:17:08 -0400 (0:00:00.074) 0:03:28.000 ******* >2018-08-30 12:17:08,242 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:08,254 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:17:08,255 p=14044 u=mistral | Thursday 30 August 2018 12:17:08 -0400 (0:00:00.033) 0:03:28.034 ******* >2018-08-30 12:17:08,637 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:08,651 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:17:08,651 p=14044 u=mistral | Thursday 30 August 2018 12:17:08 -0400 (0:00:00.396) 0:03:28.430 ******* >2018-08-30 12:17:08,706 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:08,720 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:17:08,720 p=14044 u=mistral | Thursday 30 August 2018 12:17:08 -0400 (0:00:00.069) 0:03:28.499 ******* >2018-08-30 12:17:09,119 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:09,141 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:17:09,141 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.420) 0:03:28.920 ******* >2018-08-30 12:17:09,181 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,196 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:17:09,197 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.055) 0:03:28.976 ******* >2018-08-30 12:17:09,246 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:09,264 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:09,287 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:09,302 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:17:09,302 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.105) 0:03:29.081 ******* >2018-08-30 12:17:09,340 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,358 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:17:09,359 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.056) 0:03:29.138 ******* >2018-08-30 12:17:09,397 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,416 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:17:09,416 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.057) 0:03:29.196 ******* >2018-08-30 12:17:09,454 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:17:09,454 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.037) 0:03:29.233 ******* >2018-08-30 12:17:09,506 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:17:09,507 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.052) 0:03:29.286 ******* >2018-08-30 12:17:09,536 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,550 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:17:09,551 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.043) 0:03:29.330 ******* >2018-08-30 12:17:09,581 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,596 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:17:09,596 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.045) 0:03:29.376 ******* >2018-08-30 12:17:09,628 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,644 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:17:09,645 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.047) 0:03:29.424 ******* >2018-08-30 12:17:09,677 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,691 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:17:09,692 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.047) 0:03:29.471 ******* >2018-08-30 12:17:09,724 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,738 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:17:09,738 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.046) 0:03:29.517 ******* >2018-08-30 12:17:09,769 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,783 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:17:09,783 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.044) 0:03:29.562 ******* >2018-08-30 12:17:09,809 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,823 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:17:09,824 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.040) 0:03:29.603 ******* >2018-08-30 12:17:09,850 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:09,869 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:17:09,869 p=14044 u=mistral | Thursday 30 August 2018 12:17:09 -0400 (0:00:00.045) 0:03:29.648 ******* >2018-08-30 12:17:10,242 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:10,265 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:17:10,266 p=14044 u=mistral | Thursday 30 August 2018 12:17:10 -0400 (0:00:00.396) 0:03:30.045 ******* >2018-08-30 12:17:10,292 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:10,305 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:17:10,306 p=14044 u=mistral | Thursday 30 August 2018 12:17:10 -0400 (0:00:00.040) 0:03:30.085 ******* >2018-08-30 12:17:10,339 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:10,353 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:17:10,354 p=14044 u=mistral | Thursday 30 August 2018 12:17:10 -0400 (0:00:00.047) 0:03:30.133 ******* >2018-08-30 12:17:10,381 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:10,394 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:17:10,395 p=14044 u=mistral | Thursday 30 August 2018 12:17:10 -0400 (0:00:00.041) 0:03:30.174 ******* >2018-08-30 12:17:10,796 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:10,817 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:17:10,818 p=14044 u=mistral | Thursday 30 August 2018 12:17:10 -0400 (0:00:00.422) 0:03:30.597 ******* >2018-08-30 12:17:10,845 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:10,865 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:17:10,865 p=14044 u=mistral | Thursday 30 August 2018 12:17:10 -0400 (0:00:00.047) 0:03:30.644 ******* >2018-08-30 12:17:10,895 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:10,909 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:17:10,909 p=14044 u=mistral | Thursday 30 August 2018 12:17:10 -0400 (0:00:00.043) 0:03:30.688 ******* >2018-08-30 12:17:11,287 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:11,307 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:17:11,307 p=14044 u=mistral | Thursday 30 August 2018 12:17:11 -0400 (0:00:00.398) 0:03:31.086 ******* >2018-08-30 12:17:11,335 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:11,351 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:17:11,351 p=14044 u=mistral | Thursday 30 August 2018 12:17:11 -0400 (0:00:00.043) 0:03:31.130 ******* >2018-08-30 12:17:11,383 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:11,397 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:17:11,397 p=14044 u=mistral | Thursday 30 August 2018 12:17:11 -0400 (0:00:00.046) 0:03:31.177 ******* >2018-08-30 12:17:11,429 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:11,443 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:17:11,443 p=14044 u=mistral | Thursday 30 August 2018 12:17:11 -0400 (0:00:00.045) 0:03:31.222 ******* >2018-08-30 12:17:11,824 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:11,845 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:17:11,845 p=14044 u=mistral | Thursday 30 August 2018 12:17:11 -0400 (0:00:00.401) 0:03:31.624 ******* >2018-08-30 12:17:11,872 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:11,885 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:17:11,885 p=14044 u=mistral | Thursday 30 August 2018 12:17:11 -0400 (0:00:00.040) 0:03:31.664 ******* >2018-08-30 12:17:11,912 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:11,926 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:17:11,926 p=14044 u=mistral | Thursday 30 August 2018 12:17:11 -0400 (0:00:00.040) 0:03:31.705 ******* >2018-08-30 12:17:11,993 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:12,008 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:17:12,008 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.081) 0:03:31.787 ******* >2018-08-30 12:17:12,037 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:12,053 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:17:12,053 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.045) 0:03:31.833 ******* >2018-08-30 12:17:12,090 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:12,105 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:17:12,105 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.051) 0:03:31.885 ******* >2018-08-30 12:17:12,137 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:12,151 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:17:12,151 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.045) 0:03:31.930 ******* >2018-08-30 12:17:12,231 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:12,245 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:17:12,245 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.094) 0:03:32.025 ******* >2018-08-30 12:17:12,274 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:12,288 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:17:12,289 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.043) 0:03:32.068 ******* >2018-08-30 12:17:12,318 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:12,334 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:17:12,334 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.045) 0:03:32.114 ******* >2018-08-30 12:17:12,758 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:12,774 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:17:12,775 p=14044 u=mistral | Thursday 30 August 2018 12:17:12 -0400 (0:00:00.440) 0:03:32.554 ******* >2018-08-30 12:17:13,163 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:17:13,181 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:17:13,182 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.406) 0:03:32.961 ******* >2018-08-30 12:17:13,240 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:13,256 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:17:13,256 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.074) 0:03:33.035 ******* >2018-08-30 12:17:13,292 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,305 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:17:13,305 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.049) 0:03:33.085 ******* >2018-08-30 12:17:13,332 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,346 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:17:13,346 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.040) 0:03:33.125 ******* >2018-08-30 12:17:13,374 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,389 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:17:13,389 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.043) 0:03:33.168 ******* >2018-08-30 12:17:13,418 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,431 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:17:13,432 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.042) 0:03:33.211 ******* >2018-08-30 12:17:13,467 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,480 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:17:13,481 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.048) 0:03:33.260 ******* >2018-08-30 12:17:13,506 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,520 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:17:13,521 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.039) 0:03:33.300 ******* >2018-08-30 12:17:13,550 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,570 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:17:13,570 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.049) 0:03:33.349 ******* >2018-08-30 12:17:13,600 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,613 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:17:13,613 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.042) 0:03:33.392 ******* >2018-08-30 12:17:13,643 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,655 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:17:13,655 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.042) 0:03:33.435 ******* >2018-08-30 12:17:13,679 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,692 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:17:13,693 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.037) 0:03:33.472 ******* >2018-08-30 12:17:13,720 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:13,733 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:17:13,734 p=14044 u=mistral | Thursday 30 August 2018 12:17:13 -0400 (0:00:00.040) 0:03:33.513 ******* >2018-08-30 12:17:14,792 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:14,806 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:17:14,807 p=14044 u=mistral | Thursday 30 August 2018 12:17:14 -0400 (0:00:01.072) 0:03:34.586 ******* >2018-08-30 12:17:14,865 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:14,886 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:17:14,887 p=14044 u=mistral | Thursday 30 August 2018 12:17:14 -0400 (0:00:00.079) 0:03:34.666 ******* >2018-08-30 12:17:14,922 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:14,941 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:17:14,942 p=14044 u=mistral | Thursday 30 August 2018 12:17:14 -0400 (0:00:00.055) 0:03:34.721 ******* >2018-08-30 12:17:14,976 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:14,990 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:17:14,990 p=14044 u=mistral | Thursday 30 August 2018 12:17:14 -0400 (0:00:00.048) 0:03:34.769 ******* >2018-08-30 12:17:15,055 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:15,069 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:17:15,069 p=14044 u=mistral | Thursday 30 August 2018 12:17:15 -0400 (0:00:00.078) 0:03:34.848 ******* >2018-08-30 12:17:15,110 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:15,125 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:17:15,126 p=14044 u=mistral | Thursday 30 August 2018 12:17:15 -0400 (0:00:00.056) 0:03:34.905 ******* >2018-08-30 12:17:15,155 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:15,172 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:17:15,172 p=14044 u=mistral | Thursday 30 August 2018 12:17:15 -0400 (0:00:00.046) 0:03:34.951 ******* >2018-08-30 12:17:15,536 p=14044 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:17:15,826 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:17:16,152 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:17:16,450 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:17:16,748 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:17:16,767 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:17:16,767 p=14044 u=mistral | Thursday 30 August 2018 12:17:16 -0400 (0:00:01.595) 0:03:36.546 ******* >2018-08-30 12:17:16,796 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:16,811 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:17:16,811 p=14044 u=mistral | Thursday 30 August 2018 12:17:16 -0400 (0:00:00.043) 0:03:36.590 ******* >2018-08-30 12:17:16,836 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:16,860 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:17:16,861 p=14044 u=mistral | Thursday 30 August 2018 12:17:16 -0400 (0:00:00.049) 0:03:36.640 ******* >2018-08-30 12:17:17,122 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:17:17,146 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:17:17,146 p=14044 u=mistral | Thursday 30 August 2018 12:17:17 -0400 (0:00:00.285) 0:03:36.925 ******* >2018-08-30 12:17:17,176 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:17,194 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:17:17,194 p=14044 u=mistral | Thursday 30 August 2018 12:17:17 -0400 (0:00:00.048) 0:03:36.974 ******* >2018-08-30 12:17:17,221 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:17,246 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:17:17,246 p=14044 u=mistral | Thursday 30 August 2018 12:17:17 -0400 (0:00:00.051) 0:03:37.025 ******* >2018-08-30 12:17:17,584 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:17:17,601 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:17:17,601 p=14044 u=mistral | Thursday 30 August 2018 12:17:17 -0400 (0:00:00.354) 0:03:37.380 ******* >2018-08-30 12:17:20,238 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:17:20,252 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:17:20,253 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:02.651) 0:03:40.032 ******* >2018-08-30 12:17:20,282 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,296 p=14044 u=mistral | TASK [ceph-mon : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:17:20,296 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.043) 0:03:40.076 ******* >2018-08-30 12:17:20,362 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:20,376 p=14044 u=mistral | TASK [ceph-mon : make sure monitor_interface or monitor_address or monitor_address_block is configured] *** >2018-08-30 12:17:20,377 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.080) 0:03:40.156 ******* >2018-08-30 12:17:20,413 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,435 p=14044 u=mistral | TASK [ceph-mon : generate monitor initial keyring] ***************************** >2018-08-30 12:17:20,435 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.058) 0:03:40.214 ******* >2018-08-30 12:17:20,463 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,484 p=14044 u=mistral | TASK [ceph-mon : read monitor initial keyring if it already exists] ************ >2018-08-30 12:17:20,485 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.049) 0:03:40.264 ******* >2018-08-30 12:17:20,514 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,528 p=14044 u=mistral | TASK [ceph-mon : create monitor initial keyring] ******************************* >2018-08-30 12:17:20,528 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.043) 0:03:40.308 ******* >2018-08-30 12:17:20,558 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,572 p=14044 u=mistral | TASK [ceph-mon : set initial monitor key permissions] ************************** >2018-08-30 12:17:20,573 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.044) 0:03:40.352 ******* >2018-08-30 12:17:20,608 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,622 p=14044 u=mistral | TASK [ceph-mon : create (and fix ownership of) monitor directory] ************** >2018-08-30 12:17:20,622 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.049) 0:03:40.401 ******* >2018-08-30 12:17:20,650 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,665 p=14044 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap >= ceph_release_num.luminous] *** >2018-08-30 12:17:20,665 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.042) 0:03:40.444 ******* >2018-08-30 12:17:20,695 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,709 p=14044 u=mistral | TASK [ceph-mon : set_fact client_admin_ceph_authtool_cap < ceph_release_num.luminous] *** >2018-08-30 12:17:20,709 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.044) 0:03:40.488 ******* >2018-08-30 12:17:20,740 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,754 p=14044 u=mistral | TASK [ceph-mon : create custom admin keyring] ********************************** >2018-08-30 12:17:20,754 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.044) 0:03:40.533 ******* >2018-08-30 12:17:20,783 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,797 p=14044 u=mistral | TASK [ceph-mon : set ownership of admin keyring] ******************************* >2018-08-30 12:17:20,798 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.043) 0:03:40.577 ******* >2018-08-30 12:17:20,826 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,840 p=14044 u=mistral | TASK [ceph-mon : import admin keyring into mon keyring] ************************ >2018-08-30 12:17:20,840 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.042) 0:03:40.619 ******* >2018-08-30 12:17:20,866 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,880 p=14044 u=mistral | TASK [ceph-mon : ceph monitor mkfs with keyring] ******************************* >2018-08-30 12:17:20,880 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.039) 0:03:40.659 ******* >2018-08-30 12:17:20,909 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,922 p=14044 u=mistral | TASK [ceph-mon : ceph monitor mkfs without keyring] **************************** >2018-08-30 12:17:20,922 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.042) 0:03:40.701 ******* >2018-08-30 12:17:20,950 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:20,967 p=14044 u=mistral | TASK [ceph-mon : ensure systemd service override directory exists] ************* >2018-08-30 12:17:20,967 p=14044 u=mistral | Thursday 30 August 2018 12:17:20 -0400 (0:00:00.045) 0:03:40.747 ******* >2018-08-30 12:17:21,000 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:21,014 p=14044 u=mistral | TASK [ceph-mon : add ceph-mon systemd service overrides] *********************** >2018-08-30 12:17:21,014 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.046) 0:03:40.793 ******* >2018-08-30 12:17:21,041 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:21,055 p=14044 u=mistral | TASK [ceph-mon : start the monitor service] ************************************ >2018-08-30 12:17:21,055 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.040) 0:03:40.834 ******* >2018-08-30 12:17:21,088 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:21,101 p=14044 u=mistral | TASK [ceph-mon : enable the ceph-mon.target service] *************************** >2018-08-30 12:17:21,101 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.046) 0:03:40.881 ******* >2018-08-30 12:17:21,130 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:21,144 p=14044 u=mistral | TASK [ceph-mon : include ceph_keys.yml] **************************************** >2018-08-30 12:17:21,144 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.042) 0:03:40.923 ******* >2018-08-30 12:17:21,174 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:21,188 p=14044 u=mistral | TASK [ceph-mon : collect all the pools] **************************************** >2018-08-30 12:17:21,189 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.044) 0:03:40.968 ******* >2018-08-30 12:17:21,214 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:21,230 p=14044 u=mistral | TASK [ceph-mon : secure the cluster] ******************************************* >2018-08-30 12:17:21,231 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.041) 0:03:41.010 ******* >2018-08-30 12:17:21,273 p=14044 u=mistral | TASK [ceph-mon : set_fact ceph_config_keys] ************************************ >2018-08-30 12:17:21,273 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.042) 0:03:41.053 ******* >2018-08-30 12:17:21,340 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:21,355 p=14044 u=mistral | TASK [ceph-mon : register rbd bootstrap key] *********************************** >2018-08-30 12:17:21,355 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.081) 0:03:41.134 ******* >2018-08-30 12:17:21,422 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:21,435 p=14044 u=mistral | TASK [ceph-mon : merge rbd bootstrap key to config and keys paths] ************* >2018-08-30 12:17:21,435 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.080) 0:03:41.215 ******* >2018-08-30 12:17:21,501 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:21,525 p=14044 u=mistral | TASK [ceph-mon : stat for ceph config and keys] ******************************** >2018-08-30 12:17:21,525 p=14044 u=mistral | Thursday 30 August 2018 12:17:21 -0400 (0:00:00.089) 0:03:41.304 ******* >2018-08-30 12:17:21,774 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:17:21,990 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:17:22,200 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:17:22,400 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:17:22,604 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:17:22,825 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:17:22,845 p=14044 u=mistral | TASK [ceph-mon : try to copy ceph keys] **************************************** >2018-08-30 12:17:22,846 p=14044 u=mistral | Thursday 30 August 2018 12:17:22 -0400 (0:00:01.320) 0:03:42.625 ******* >2018-08-30 12:17:23,606 p=14044 u=mistral | ok: [172.16.0.25] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:23,641 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:24,327 p=14044 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:25,038 p=14044 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:25,745 p=14044 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:25,772 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:25,795 p=14044 u=mistral | TASK [ceph-mon : populate kv_store with default ceph.conf] ********************* >2018-08-30 12:17:25,795 p=14044 u=mistral | Thursday 30 August 2018 12:17:25 -0400 (0:00:02.949) 0:03:45.574 ******* >2018-08-30 12:17:25,819 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:17:25,828 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:25,843 p=14044 u=mistral | TASK [ceph-mon : populate kv_store with custom ceph.conf] ********************** >2018-08-30 12:17:25,843 p=14044 u=mistral | Thursday 30 August 2018 12:17:25 -0400 (0:00:00.047) 0:03:45.622 ******* >2018-08-30 12:17:25,866 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ inventory_hostname == >groups[mon_group_name][0] }} > >2018-08-30 12:17:25,875 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:25,891 p=14044 u=mistral | TASK [ceph-mon : delete populate-kv-store docker] ****************************** >2018-08-30 12:17:25,891 p=14044 u=mistral | Thursday 30 August 2018 12:17:25 -0400 (0:00:00.048) 0:03:45.671 ******* >2018-08-30 12:17:25,918 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:25,932 p=14044 u=mistral | TASK [ceph-mon : generate systemd unit file] *********************************** >2018-08-30 12:17:25,932 p=14044 u=mistral | Thursday 30 August 2018 12:17:25 -0400 (0:00:00.041) 0:03:45.712 ******* >2018-08-30 12:17:27,023 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:27,038 p=14044 u=mistral | TASK [ceph-mon : systemd start mon container] ********************************** >2018-08-30 12:17:27,038 p=14044 u=mistral | Thursday 30 August 2018 12:17:27 -0400 (0:00:01.106) 0:03:46.818 ******* >2018-08-30 12:17:27,586 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:27,601 p=14044 u=mistral | TASK [ceph-mon : configure ceph profile.d aliases] ***************************** >2018-08-30 12:17:27,601 p=14044 u=mistral | Thursday 30 August 2018 12:17:27 -0400 (0:00:00.562) 0:03:47.381 ******* >2018-08-30 12:17:28,627 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:28,650 p=14044 u=mistral | TASK [ceph-mon : wait for monitor socket to exist] ***************************** >2018-08-30 12:17:28,651 p=14044 u=mistral | Thursday 30 August 2018 12:17:28 -0400 (0:00:01.049) 0:03:48.430 ******* >2018-08-30 12:17:29,249 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:17:29,264 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:17:29,264 p=14044 u=mistral | Thursday 30 August 2018 12:17:29 -0400 (0:00:00.613) 0:03:49.043 ******* >2018-08-30 12:17:29,329 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:29,350 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:17:29,350 p=14044 u=mistral | Thursday 30 August 2018 12:17:29 -0400 (0:00:00.085) 0:03:49.129 ******* >2018-08-30 12:17:29,416 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:29,438 p=14044 u=mistral | TASK [ceph-mon : ipv4 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:17:29,438 p=14044 u=mistral | Thursday 30 August 2018 12:17:29 -0400 (0:00:00.088) 0:03:49.217 ******* >2018-08-30 12:17:30,165 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:30,179 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_interface] *** >2018-08-30 12:17:30,180 p=14044 u=mistral | Thursday 30 August 2018 12:17:30 -0400 (0:00:00.741) 0:03:49.959 ******* >2018-08-30 12:17:30,211 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:30,226 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address] *** >2018-08-30 12:17:30,226 p=14044 u=mistral | Thursday 30 August 2018 12:17:30 -0400 (0:00:00.046) 0:03:50.005 ******* >2018-08-30 12:17:30,259 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:30,274 p=14044 u=mistral | TASK [ceph-mon : ipv6 - force peer addition as potential bootstrap peer for cluster bringup - monitor_address_block] *** >2018-08-30 12:17:30,274 p=14044 u=mistral | Thursday 30 August 2018 12:17:30 -0400 (0:00:00.047) 0:03:50.053 ******* >2018-08-30 12:17:30,309 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:30,324 p=14044 u=mistral | TASK [ceph-mon : push ceph files to the ansible server] ************************ >2018-08-30 12:17:30,325 p=14044 u=mistral | Thursday 30 August 2018 12:17:30 -0400 (0:00:00.050) 0:03:50.104 ******* >2018-08-30 12:17:30,396 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.208, u'block_size': 4096, u'inode': 50344676, u'isgid': False, u'size': 129, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'xusr': False, u'atime': 1535645064.209, u'md5': u'e967771c3cc4547ea805f65fa2cb47df', u'isdir': False, u'ctime': 1535645064.208, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'182fd4b3cd72fcc5c1039d6ed2c6dc32b957a493', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.client.admin.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:30,723 p=14044 u=mistral | ok: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mon.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//etc/ceph/ceph.mon.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:30,758 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645064.828, u'block_size': 4096, u'inode': 67131444, u'isgid': False, u'size': 113, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'xusr': False, u'atime': 1535645084.638, u'md5': u'4657c6aba3a55307a142d93650fd08b7', u'isdir': False, u'ctime': 1535645064.828, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'18fd923b0dfb5adb2fc8f9a359c468043f662579', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-osd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:30,787 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.151, u'block_size': 4096, u'inode': 71323238, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'xusr': False, u'atime': 1535645084.915, u'md5': u'21de6593e72a66c1a80f509c49912cbf', u'isdir': False, u'ctime': 1535645065.151, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'026d2a8b405c5e1c51392a3860afc2112a1f0d78', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rgw/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:30,813 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'isuid': False, u'uid': 995, u'exists': True, u'attr_flags': u'', u'woth': False, u'isreg': True, u'device_type': 0, u'mtime': 1535645065.446, u'block_size': 4096, u'inode': 75541042, u'isgid': False, u'size': 71, u'wgrp': False, u'executable': False, u'charset': u'unknown', u'readable': True, u'version': None, u'pw_name': u'mistral', u'gid': 992, u'ischr': False, u'wusr': True, u'writeable': True, u'mimetype': u'unknown', u'blocks': 8, u'xoth': False, u'islnk': False, u'nlink': 1, u'issock': False, u'rgrp': True, u'gr_name': u'mistral', u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'xusr': False, u'atime': 1535645085.205, u'md5': u'624d2bec4ae4ec3bf580e6427831b60f', u'isdir': False, u'ctime': 1535645065.446, u'isblk': False, u'xgrp': False, u'dev': 64513, u'roth': True, u'isfifo': False, u'mode': u'0644', u'checksum': u'3badb469305ed0c764cbd87c107bff964cec554d', u'rusr': True, u'attributes': []}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-mds/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:31,135 p=14044 u=mistral | ok: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'_ansible_parsed': True, u'stat': {u'exists': False}, u'changed': False, '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'localhost', 'ansible_host': u'localhost'}, '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', u'invocation': {u'module_args': {u'checksum_algorithm': u'sha1', u'get_checksum': True, u'follow': False, u'path': u'/tmp/file-mistral-actionLfF8RH/b174c44c-96ac-11e8-a22b-525400932152//var/lib/ceph/bootstrap-rbd/ceph.keyring', u'get_md5': True, u'get_mime': True, u'get_attributes': True}}, 'failed_when_result': False, '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:17:31,159 p=14044 u=mistral | TASK [ceph-mon : create ceph rest api keyring when mon is containerized] ******* >2018-08-30 12:17:31,160 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.835) 0:03:50.939 ******* >2018-08-30 12:17:31,192 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:31,208 p=14044 u=mistral | TASK [ceph-mon : create ceph mgr keyring(s) when mon is containerized] ********* >2018-08-30 12:17:31,209 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.048) 0:03:50.988 ******* >2018-08-30 12:17:31,251 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:31,267 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:31,276 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:31,296 p=14044 u=mistral | TASK [ceph-mon : stat for ceph mgr key(s)] ************************************* >2018-08-30 12:17:31,296 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.087) 0:03:51.076 ******* >2018-08-30 12:17:31,345 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:31,353 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:31,363 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:31,379 p=14044 u=mistral | TASK [ceph-mon : fetch ceph mgr key(s)] **************************************** >2018-08-30 12:17:31,379 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.082) 0:03:51.158 ******* >2018-08-30 12:17:31,421 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.33', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:17:31,427 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.24', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:17:31,439 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'172.16.0.25', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:17:31,455 p=14044 u=mistral | TASK [ceph-mon : configure crush hierarchy] ************************************ >2018-08-30 12:17:31,455 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.076) 0:03:51.235 ******* >2018-08-30 12:17:31,492 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.28) >2018-08-30 12:17:31,501 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.36) >2018-08-30 12:17:31,512 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.32) >2018-08-30 12:17:31,533 p=14044 u=mistral | TASK [ceph-mon : create configured crush rules] ******************************** >2018-08-30 12:17:31,533 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.077) 0:03:51.312 ******* >2018-08-30 12:17:31,574 p=14044 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:17:31,579 p=14044 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:17:31,597 p=14044 u=mistral | TASK [ceph-mon : get id for new default crush rule] **************************** >2018-08-30 12:17:31,597 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.064) 0:03:51.377 ******* >2018-08-30 12:17:31,639 p=14044 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'HDD', u'type': u'host', u'name': u'HDD'}) >2018-08-30 12:17:31,644 p=14044 u=mistral | skipping: [172.16.0.25] => (item={u'default': False, u'root': u'SSD', u'type': u'host', u'name': u'SSD'}) >2018-08-30 12:17:31,669 p=14044 u=mistral | TASK [ceph-mon : set_fact info_ceph_default_crush_rule_yaml] ******************* >2018-08-30 12:17:31,669 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.072) 0:03:51.449 ******* >2018-08-30 12:17:31,705 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'HDD', u'name': u'HDD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:17:31,709 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'default': False, u'type': u'host', u'root': u'SSD', u'name': u'SSD'}, 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:17:31,730 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_crush_rule to osd_pool_default_crush_replicated_ruleset if release < luminous else osd_pool_default_crush_rule] *** >2018-08-30 12:17:31,731 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.061) 0:03:51.510 ******* >2018-08-30 12:17:31,764 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:31,849 p=14044 u=mistral | TASK [ceph-mon : insert new default crush rule into daemon to prevent restart] *** >2018-08-30 12:17:31,849 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.118) 0:03:51.628 ******* >2018-08-30 12:17:31,887 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:31,894 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:31,899 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:31,960 p=14044 u=mistral | TASK [ceph-mon : add new default crush rule to ceph.conf] ********************** >2018-08-30 12:17:31,960 p=14044 u=mistral | Thursday 30 August 2018 12:17:31 -0400 (0:00:00.110) 0:03:51.739 ******* >2018-08-30 12:17:31,998 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:32,007 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:32,010 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:32,025 p=14044 u=mistral | TASK [ceph-mon : get default value for osd_pool_default_pg_num] **************** >2018-08-30 12:17:32,026 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.065) 0:03:51.805 ******* >2018-08-30 12:17:32,062 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:32,078 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with pool_default_pg_num (backward compatibility)] *** >2018-08-30 12:17:32,078 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.052) 0:03:51.858 ******* >2018-08-30 12:17:32,110 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:32,125 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num with default_pool_default_pg_num.stdout] *** >2018-08-30 12:17:32,126 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.047) 0:03:51.905 ******* >2018-08-30 12:17:32,158 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:32,173 p=14044 u=mistral | TASK [ceph-mon : set_fact osd_pool_default_pg_num ceph_conf_overrides.global.osd_pool_default_pg_num] *** >2018-08-30 12:17:32,173 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.047) 0:03:51.953 ******* >2018-08-30 12:17:32,240 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:32,263 p=14044 u=mistral | TASK [ceph-mon : increase calamari logging level when debug is on] ************* >2018-08-30 12:17:32,263 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.089) 0:03:52.042 ******* >2018-08-30 12:17:32,294 p=14044 u=mistral | skipping: [172.16.0.25] => (item=cthulhu) >2018-08-30 12:17:32,300 p=14044 u=mistral | skipping: [172.16.0.25] => (item=calamari_web) >2018-08-30 12:17:32,321 p=14044 u=mistral | TASK [ceph-mon : initialize the calamari server api] *************************** >2018-08-30 12:17:32,321 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.058) 0:03:52.100 ******* >2018-08-30 12:17:32,345 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:32,347 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:17:32,347 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.025) 0:03:52.126 ******* >2018-08-30 12:17:32,419 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:32,420 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:17:32,420 p=14044 u=mistral | Thursday 30 August 2018 12:17:32 -0400 (0:00:00.072) 0:03:52.199 ******* >2018-08-30 12:17:33,211 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:33,212 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:17:33,213 p=14044 u=mistral | Thursday 30 August 2018 12:17:33 -0400 (0:00:00.792) 0:03:52.992 ******* >2018-08-30 12:17:33,301 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:33,311 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:33,322 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:33,323 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:17:33,323 p=14044 u=mistral | Thursday 30 August 2018 12:17:33 -0400 (0:00:00.110) 0:03:53.103 ******* >2018-08-30 12:17:33,451 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:33,500 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:45,159 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:45,162 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:17:45,162 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:11.838) 0:04:04.941 ******* >2018-08-30 12:17:45,228 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:45,229 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:17:45,230 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.067) 0:04:05.009 ******* >2018-08-30 12:17:45,299 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:45,300 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:17:45,300 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.070) 0:04:05.080 ******* >2018-08-30 12:17:45,347 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:45,348 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:17:45,348 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.047) 0:04:05.127 ******* >2018-08-30 12:17:45,434 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.28) >2018-08-30 12:17:45,440 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.36) >2018-08-30 12:17:45,447 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.32) >2018-08-30 12:17:45,448 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:17:45,449 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.100) 0:04:05.228 ******* >2018-08-30 12:17:45,532 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.28) >2018-08-30 12:17:45,540 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.36) >2018-08-30 12:17:45,546 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.32) >2018-08-30 12:17:45,548 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:17:45,548 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.099) 0:04:05.327 ******* >2018-08-30 12:17:45,614 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:45,615 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:17:45,615 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.066) 0:04:05.394 ******* >2018-08-30 12:17:45,677 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:45,678 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:17:45,678 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.063) 0:04:05.457 ******* >2018-08-30 12:17:45,724 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:45,725 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:17:45,726 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.047) 0:04:05.505 ******* >2018-08-30 12:17:45,778 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:17:45,779 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.052) 0:04:05.558 ******* >2018-08-30 12:17:45,832 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:17:45,832 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.053) 0:04:05.611 ******* >2018-08-30 12:17:45,914 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:45,916 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:17:45,916 p=14044 u=mistral | Thursday 30 August 2018 12:17:45 -0400 (0:00:00.083) 0:04:05.695 ******* >2018-08-30 12:17:45,999 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:46,000 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:17:46,000 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.083) 0:04:05.779 ******* >2018-08-30 12:17:46,045 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:46,045 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:17:46,046 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.045) 0:04:05.825 ******* >2018-08-30 12:17:46,094 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:17:46,094 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.048) 0:04:05.874 ******* >2018-08-30 12:17:46,141 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:17:46,142 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.047) 0:04:05.921 ******* >2018-08-30 12:17:46,220 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:46,221 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:17:46,221 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.079) 0:04:06.000 ******* >2018-08-30 12:17:46,299 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:46,300 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:17:46,300 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.078) 0:04:06.079 ******* >2018-08-30 12:17:46,341 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:46,341 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:17:46,342 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.041) 0:04:06.121 ******* >2018-08-30 12:17:46,382 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:17:46,383 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.041) 0:04:06.162 ******* >2018-08-30 12:17:46,424 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:17:46,425 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.041) 0:04:06.204 ******* >2018-08-30 12:17:46,490 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:46,491 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:17:46,491 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.066) 0:04:06.270 ******* >2018-08-30 12:17:46,556 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:46,557 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:17:46,558 p=14044 u=mistral | Thursday 30 August 2018 12:17:46 -0400 (0:00:00.066) 0:04:06.337 ******* >2018-08-30 12:17:47,350 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:47,351 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:17:47,352 p=14044 u=mistral | Thursday 30 August 2018 12:17:47 -0400 (0:00:00.793) 0:04:07.131 ******* >2018-08-30 12:17:47,460 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:47,471 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:47,481 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:47,482 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:17:47,482 p=14044 u=mistral | Thursday 30 August 2018 12:17:47 -0400 (0:00:00.130) 0:04:07.262 ******* >2018-08-30 12:17:47,611 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:47,647 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:58,443 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:58,445 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:17:58,446 p=14044 u=mistral | Thursday 30 August 2018 12:17:58 -0400 (0:00:10.963) 0:04:18.225 ******* >2018-08-30 12:17:58,506 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:58,520 p=14044 u=mistral | TASK [start ceph mon] ********************************************************** >2018-08-30 12:17:58,520 p=14044 u=mistral | Thursday 30 August 2018 12:17:58 -0400 (0:00:00.074) 0:04:18.300 ******* >2018-08-30 12:17:58,551 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:17:58,563 p=14044 u=mistral | TASK [restart containerized ceph mon] ****************************************** >2018-08-30 12:17:58,563 p=14044 u=mistral | Thursday 30 August 2018 12:17:58 -0400 (0:00:00.042) 0:04:18.343 ******* >2018-08-30 12:17:59,662 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:17:59,677 p=14044 u=mistral | TASK [set mon_host_count] ****************************************************** >2018-08-30 12:17:59,677 p=14044 u=mistral | Thursday 30 August 2018 12:17:59 -0400 (0:00:01.113) 0:04:19.457 ******* >2018-08-30 12:17:59,752 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:17:59,765 p=14044 u=mistral | TASK [select a running monitor if multiple monitors] *************************** >2018-08-30 12:17:59,766 p=14044 u=mistral | Thursday 30 August 2018 12:17:59 -0400 (0:00:00.088) 0:04:19.545 ******* >2018-08-30 12:17:59,843 p=14044 u=mistral | ok: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:59,868 p=14044 u=mistral | ok: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:17:59,874 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:17:59,889 p=14044 u=mistral | TASK [select first monitor if only one monitor] ******************************** >2018-08-30 12:17:59,890 p=14044 u=mistral | Thursday 30 August 2018 12:17:59 -0400 (0:00:00.123) 0:04:19.669 ******* >2018-08-30 12:17:59,929 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:17:59,964 p=14044 u=mistral | TASK [non container | waiting for the monitor to join the quorum...] *********** >2018-08-30 12:17:59,965 p=14044 u=mistral | Thursday 30 August 2018 12:17:59 -0400 (0:00:00.074) 0:04:19.744 ******* >2018-08-30 12:17:59,996 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:18:00,033 p=14044 u=mistral | TASK [container | waiting for the containerized monitor to join the quorum...] *** >2018-08-30 12:18:00,033 p=14044 u=mistral | Thursday 30 August 2018 12:18:00 -0400 (0:00:00.068) 0:04:19.813 ******* >2018-08-30 12:18:01,062 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.24] >2018-08-30 12:18:01,094 p=14044 u=mistral | TASK [set osd flags] *********************************************************** >2018-08-30 12:18:01,095 p=14044 u=mistral | Thursday 30 August 2018 12:18:01 -0400 (0:00:01.061) 0:04:20.874 ******* >2018-08-30 12:18:01,125 p=14044 u=mistral | skipping: [172.16.0.25] => (item=noout) >2018-08-30 12:18:01,131 p=14044 u=mistral | skipping: [172.16.0.25] => (item=noscrub) >2018-08-30 12:18:01,138 p=14044 u=mistral | skipping: [172.16.0.25] => (item=nodeep-scrub) >2018-08-30 12:18:01,166 p=14044 u=mistral | TASK [set containerized osd flags] ********************************************* >2018-08-30 12:18:01,166 p=14044 u=mistral | Thursday 30 August 2018 12:18:01 -0400 (0:00:00.071) 0:04:20.946 ******* >2018-08-30 12:18:02,843 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.24] => (item=noout) >2018-08-30 12:18:03,845 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.24] => (item=noscrub) >2018-08-30 12:18:05,901 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.24] => (item=nodeep-scrub) >2018-08-30 12:18:05,921 p=14044 u=mistral | PLAY [upgrade ceph mgr node] *************************************************** >2018-08-30 12:18:06,035 p=14044 u=mistral | TASK [non container - get current fsid] **************************************** >2018-08-30 12:18:06,036 p=14044 u=mistral | Thursday 30 August 2018 12:18:06 -0400 (0:00:04.869) 0:04:25.815 ******* >2018-08-30 12:18:06,066 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:06,090 p=14044 u=mistral | TASK [container - get current fsid] ******************************************** >2018-08-30 12:18:06,091 p=14044 u=mistral | Thursday 30 August 2018 12:18:06 -0400 (0:00:00.055) 0:04:25.870 ******* >2018-08-30 12:18:07,248 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:18:07,267 p=14044 u=mistral | TASK [set_fact ceph_cluster_fsid] ********************************************** >2018-08-30 12:18:07,267 p=14044 u=mistral | Thursday 30 August 2018 12:18:07 -0400 (0:00:01.176) 0:04:27.047 ******* >2018-08-30 12:18:07,512 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:07,544 p=14044 u=mistral | TASK [non container | create ceph mgr keyring(s)] ****************************** >2018-08-30 12:18:07,544 p=14044 u=mistral | Thursday 30 August 2018 12:18:07 -0400 (0:00:00.276) 0:04:27.323 ******* >2018-08-30 12:18:07,579 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:18:07,586 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:18:07,593 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:18:07,628 p=14044 u=mistral | TASK [container | create ceph mgr keyring(s)] ********************************** >2018-08-30 12:18:07,628 p=14044 u=mistral | Thursday 30 August 2018 12:18:07 -0400 (0:00:00.084) 0:04:27.408 ******* >2018-08-30 12:18:07,656 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ groups.get(mgr_group_name, []) | length > 0 >}} > >2018-08-30 12:18:08,744 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:18:09,652 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:18:10,575 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:18:10,610 p=14044 u=mistral | TASK [fetch ceph mgr key(s)] *************************************************** >2018-08-30 12:18:10,610 p=14044 u=mistral | Thursday 30 August 2018 12:18:10 -0400 (0:00:02.981) 0:04:30.390 ******* >2018-08-30 12:18:10,974 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:18:11,294 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:18:11,594 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:18:11,611 p=14044 u=mistral | TASK [stop ceph mgr] *********************************************************** >2018-08-30 12:18:11,611 p=14044 u=mistral | Thursday 30 August 2018 12:18:11 -0400 (0:00:01.000) 0:04:31.390 ******* >2018-08-30 12:18:11,643 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:11,658 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:18:11,658 p=14044 u=mistral | Thursday 30 August 2018 12:18:11 -0400 (0:00:00.046) 0:04:31.437 ******* >2018-08-30 12:18:12,063 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:12,078 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:18:12,079 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.420) 0:04:31.858 ******* >2018-08-30 12:18:12,113 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,130 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:18:12,131 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.052) 0:04:31.910 ******* >2018-08-30 12:18:12,162 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,186 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:18:12,187 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.056) 0:04:31.966 ******* >2018-08-30 12:18:12,222 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,238 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:18:12,238 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.051) 0:04:32.017 ******* >2018-08-30 12:18:12,600 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:12,616 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:18:12,617 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.378) 0:04:32.396 ******* >2018-08-30 12:18:12,650 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,666 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:18:12,666 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.049) 0:04:32.446 ******* >2018-08-30 12:18:12,701 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,717 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:18:12,717 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.050) 0:04:32.496 ******* >2018-08-30 12:18:12,757 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,773 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:18:12,773 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.056) 0:04:32.552 ******* >2018-08-30 12:18:12,807 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,822 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:18:12,823 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.049) 0:04:32.602 ******* >2018-08-30 12:18:12,861 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,877 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:18:12,878 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.054) 0:04:32.657 ******* >2018-08-30 12:18:12,910 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,927 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:18:12,927 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.049) 0:04:32.706 ******* >2018-08-30 12:18:12,959 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:12,974 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:18:12,975 p=14044 u=mistral | Thursday 30 August 2018 12:18:12 -0400 (0:00:00.047) 0:04:32.754 ******* >2018-08-30 12:18:13,007 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,023 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:18:13,023 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.048) 0:04:32.803 ******* >2018-08-30 12:18:13,061 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,076 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:18:13,076 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.052) 0:04:32.855 ******* >2018-08-30 12:18:13,107 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,122 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:18:13,122 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.046) 0:04:32.901 ******* >2018-08-30 12:18:13,161 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,177 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:18:13,177 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.055) 0:04:32.956 ******* >2018-08-30 12:18:13,212 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,227 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:18:13,227 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.050) 0:04:33.007 ******* >2018-08-30 12:18:13,261 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,276 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:18:13,276 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.048) 0:04:33.055 ******* >2018-08-30 12:18:13,306 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,321 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:18:13,321 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.044) 0:04:33.100 ******* >2018-08-30 12:18:13,352 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,367 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:18:13,368 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.046) 0:04:33.147 ******* >2018-08-30 12:18:13,400 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,416 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:18:13,416 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.048) 0:04:33.195 ******* >2018-08-30 12:18:13,447 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,461 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:18:13,462 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.045) 0:04:33.241 ******* >2018-08-30 12:18:13,489 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,504 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:18:13,504 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.042) 0:04:33.284 ******* >2018-08-30 12:18:13,534 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,549 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:18:13,550 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.045) 0:04:33.329 ******* >2018-08-30 12:18:13,583 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,598 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:18:13,598 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.048) 0:04:33.377 ******* >2018-08-30 12:18:13,629 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,643 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:18:13,643 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.045) 0:04:33.423 ******* >2018-08-30 12:18:13,670 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,684 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:18:13,684 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.040) 0:04:33.463 ******* >2018-08-30 12:18:13,713 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:13,728 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:18:13,728 p=14044 u=mistral | Thursday 30 August 2018 12:18:13 -0400 (0:00:00.044) 0:04:33.507 ******* >2018-08-30 12:18:14,043 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:14,057 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:18:14,057 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.329) 0:04:33.836 ******* >2018-08-30 12:18:14,120 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:14,136 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:18:14,136 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.079) 0:04:33.916 ******* >2018-08-30 12:18:14,198 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:14,213 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:18:14,213 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.076) 0:04:33.993 ******* >2018-08-30 12:18:14,235 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:14,263 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:18:14,263 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.049) 0:04:34.043 ******* >2018-08-30 12:18:14,361 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:18:14,394 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:18:14,394 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.130) 0:04:34.173 ******* >2018-08-30 12:18:14,425 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:14,448 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:18:14,448 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.053) 0:04:34.227 ******* >2018-08-30 12:18:14,675 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:18:14,689 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:18:14,690 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.241) 0:04:34.469 ******* >2018-08-30 12:18:14,767 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:14,789 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:18:14,789 p=14044 u=mistral | Thursday 30 August 2018 12:18:14 -0400 (0:00:00.099) 0:04:34.568 ******* >2018-08-30 12:18:15,021 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:18:15,036 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:18:15,036 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.247) 0:04:34.815 ******* >2018-08-30 12:18:15,073 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,091 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:18:15,092 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.055) 0:04:34.871 ******* >2018-08-30 12:18:15,160 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:15,183 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:18:15,183 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.091) 0:04:34.962 ******* >2018-08-30 12:18:15,207 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,228 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:18:15,228 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.045) 0:04:35.008 ******* >2018-08-30 12:18:15,259 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,282 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:18:15,282 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.053) 0:04:35.061 ******* >2018-08-30 12:18:15,310 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,326 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:18:15,327 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.044) 0:04:35.106 ******* >2018-08-30 12:18:15,355 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,374 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:18:15,375 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.047) 0:04:35.154 ******* >2018-08-30 12:18:15,445 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:15,465 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:18:15,465 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.090) 0:04:35.244 ******* >2018-08-30 12:18:15,494 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,510 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:18:15,511 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.045) 0:04:35.290 ******* >2018-08-30 12:18:15,546 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,560 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:18:15,560 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.049) 0:04:35.339 ******* >2018-08-30 12:18:15,591 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,606 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:18:15,606 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.045) 0:04:35.385 ******* >2018-08-30 12:18:15,636 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,650 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:18:15,650 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.043) 0:04:35.429 ******* >2018-08-30 12:18:15,685 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/dev/vdb) >2018-08-30 12:18:15,701 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:18:15,701 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.051) 0:04:35.480 ******* >2018-08-30 12:18:15,738 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:18:15,754 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:18:15,754 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.053) 0:04:35.534 ******* >2018-08-30 12:18:15,786 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,801 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:18:15,802 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.047) 0:04:35.581 ******* >2018-08-30 12:18:15,832 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,847 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:18:15,847 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.045) 0:04:35.626 ******* >2018-08-30 12:18:15,873 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,890 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:18:15,890 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.042) 0:04:35.669 ******* >2018-08-30 12:18:15,920 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,935 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:18:15,935 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.045) 0:04:35.714 ******* >2018-08-30 12:18:15,964 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:15,984 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:18:15,984 p=14044 u=mistral | Thursday 30 August 2018 12:18:15 -0400 (0:00:00.048) 0:04:35.763 ******* >2018-08-30 12:18:16,050 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:16,068 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:18:16,068 p=14044 u=mistral | Thursday 30 August 2018 12:18:16 -0400 (0:00:00.083) 0:04:35.847 ******* >2018-08-30 12:18:16,138 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:16,157 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:18:16,158 p=14044 u=mistral | Thursday 30 August 2018 12:18:16 -0400 (0:00:00.089) 0:04:35.937 ******* >2018-08-30 12:18:16,485 p=14044 u=mistral | ok: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:18:16,762 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/) >2018-08-30 12:18:17,044 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mon) >2018-08-30 12:18:17,357 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/osd) >2018-08-30 12:18:17,645 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mds) >2018-08-30 12:18:17,933 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/tmp) >2018-08-30 12:18:18,213 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:18:18,500 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:18:18,933 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:18:19,238 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:18:19,525 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:18:19,823 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:18:19,845 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:18:19,845 p=14044 u=mistral | Thursday 30 August 2018 12:18:19 -0400 (0:00:03.687) 0:04:39.624 ******* >2018-08-30 12:18:19,876 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:19,892 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:18:19,892 p=14044 u=mistral | Thursday 30 August 2018 12:18:19 -0400 (0:00:00.046) 0:04:39.671 ******* >2018-08-30 12:18:19,919 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:19,935 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:18:19,935 p=14044 u=mistral | Thursday 30 August 2018 12:18:19 -0400 (0:00:00.043) 0:04:39.715 ******* >2018-08-30 12:18:19,961 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:19,976 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:18:19,977 p=14044 u=mistral | Thursday 30 August 2018 12:18:19 -0400 (0:00:00.041) 0:04:39.756 ******* >2018-08-30 12:18:20,004 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,020 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:18:20,020 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.043) 0:04:39.800 ******* >2018-08-30 12:18:20,052 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,067 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:18:20,068 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.047) 0:04:39.847 ******* >2018-08-30 12:18:20,098 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,116 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:18:20,116 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.048) 0:04:39.895 ******* >2018-08-30 12:18:20,147 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,163 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:18:20,163 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.047) 0:04:39.943 ******* >2018-08-30 12:18:20,193 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,210 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:18:20,210 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.046) 0:04:39.989 ******* >2018-08-30 12:18:20,240 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,253 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:18:20,254 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.043) 0:04:40.033 ******* >2018-08-30 12:18:20,287 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,301 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:18:20,301 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.047) 0:04:40.080 ******* >2018-08-30 12:18:20,335 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,349 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:18:20,349 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.048) 0:04:40.129 ******* >2018-08-30 12:18:20,376 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,392 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:18:20,393 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.042) 0:04:40.172 ******* >2018-08-30 12:18:20,418 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,433 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:18:20,434 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.041) 0:04:40.213 ******* >2018-08-30 12:18:20,465 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,480 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:18:20,481 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.047) 0:04:40.260 ******* >2018-08-30 12:18:20,511 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,527 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:18:20,527 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.046) 0:04:40.306 ******* >2018-08-30 12:18:20,556 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,570 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:18:20,570 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.042) 0:04:40.349 ******* >2018-08-30 12:18:20,605 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,620 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:18:20,621 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.050) 0:04:40.400 ******* >2018-08-30 12:18:20,655 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,670 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:18:20,670 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.049) 0:04:40.449 ******* >2018-08-30 12:18:20,710 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,732 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:18:20,732 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.062) 0:04:40.511 ******* >2018-08-30 12:18:20,772 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,787 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:18:20,788 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.055) 0:04:40.567 ******* >2018-08-30 12:18:20,826 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,852 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:18:20,853 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.065) 0:04:40.632 ******* >2018-08-30 12:18:20,884 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,900 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:18:20,901 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.047) 0:04:40.680 ******* >2018-08-30 12:18:20,932 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,947 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:18:20,948 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.046) 0:04:40.727 ******* >2018-08-30 12:18:20,983 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:20,997 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:18:20,998 p=14044 u=mistral | Thursday 30 August 2018 12:18:20 -0400 (0:00:00.050) 0:04:40.777 ******* >2018-08-30 12:18:21,030 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,045 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:18:21,045 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.047) 0:04:40.825 ******* >2018-08-30 12:18:21,073 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,089 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:18:21,089 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.043) 0:04:40.868 ******* >2018-08-30 12:18:21,115 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,134 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-controller03/keyring already exists] *** >2018-08-30 12:18:21,134 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.045) 0:04:40.914 ******* >2018-08-30 12:18:21,165 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,191 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-controller03/keyring doesn't exist] *** >2018-08-30 12:18:21,192 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.057) 0:04:40.971 ******* >2018-08-30 12:18:21,224 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,240 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:18:21,241 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.048) 0:04:41.020 ******* >2018-08-30 12:18:21,269 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,289 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:18:21,290 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.049) 0:04:41.069 ******* >2018-08-30 12:18:21,322 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,339 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:18:21,339 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.049) 0:04:41.118 ******* >2018-08-30 12:18:21,370 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,396 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:18:21,396 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.056) 0:04:41.175 ******* >2018-08-30 12:18:21,425 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,444 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:18:21,444 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.048) 0:04:41.223 ******* >2018-08-30 12:18:21,474 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,489 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:18:21,490 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.045) 0:04:41.269 ******* >2018-08-30 12:18:21,528 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:18:21,538 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/log/ceph) >2018-08-30 12:18:21,553 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:18:21,553 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.063) 0:04:41.332 ******* >2018-08-30 12:18:21,582 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,596 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:18:21,597 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.043) 0:04:41.376 ******* >2018-08-30 12:18:21,627 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,640 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:18:21,641 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.043) 0:04:41.420 ******* >2018-08-30 12:18:21,670 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,684 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:18:21,684 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.043) 0:04:41.464 ******* >2018-08-30 12:18:21,713 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,728 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:18:21,729 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.044) 0:04:41.508 ******* >2018-08-30 12:18:21,756 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,770 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:18:21,771 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.041) 0:04:41.550 ******* >2018-08-30 12:18:21,802 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,818 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:18:21,818 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.047) 0:04:41.597 ******* >2018-08-30 12:18:21,848 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,862 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:18:21,863 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.044) 0:04:41.642 ******* >2018-08-30 12:18:21,902 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,919 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:18:21,920 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.056) 0:04:41.699 ******* >2018-08-30 12:18:21,948 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:21,964 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:18:21,965 p=14044 u=mistral | Thursday 30 August 2018 12:18:21 -0400 (0:00:00.044) 0:04:41.744 ******* >2018-08-30 12:18:22,317 p=14044 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:18:22,613 p=14044 u=mistral | ok: [172.16.0.33] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:18:22,630 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:18:22,630 p=14044 u=mistral | Thursday 30 August 2018 12:18:22 -0400 (0:00:00.665) 0:04:42.409 ******* >2018-08-30 12:18:22,702 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:22,716 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:18:22,716 p=14044 u=mistral | Thursday 30 August 2018 12:18:22 -0400 (0:00:00.086) 0:04:42.495 ******* >2018-08-30 12:18:22,744 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:22,757 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:18:22,757 p=14044 u=mistral | Thursday 30 August 2018 12:18:22 -0400 (0:00:00.041) 0:04:42.537 ******* >2018-08-30 12:18:23,119 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:23,140 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:18:23,140 p=14044 u=mistral | Thursday 30 August 2018 12:18:23 -0400 (0:00:00.382) 0:04:42.919 ******* >2018-08-30 12:18:23,199 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:23,217 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:18:23,217 p=14044 u=mistral | Thursday 30 August 2018 12:18:23 -0400 (0:00:00.077) 0:04:42.997 ******* >2018-08-30 12:18:23,595 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:23,622 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:18:23,622 p=14044 u=mistral | Thursday 30 August 2018 12:18:23 -0400 (0:00:00.404) 0:04:43.401 ******* >2018-08-30 12:18:23,663 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:23,679 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:18:23,680 p=14044 u=mistral | Thursday 30 August 2018 12:18:23 -0400 (0:00:00.057) 0:04:43.459 ******* >2018-08-30 12:18:23,736 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:18:23,757 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:18:23,776 p=14044 u=mistral | skipping: [172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:18:23,792 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:18:23,792 p=14044 u=mistral | Thursday 30 August 2018 12:18:23 -0400 (0:00:00.112) 0:04:43.571 ******* >2018-08-30 12:18:23,833 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:23,848 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:18:23,848 p=14044 u=mistral | Thursday 30 August 2018 12:18:23 -0400 (0:00:00.056) 0:04:43.628 ******* >2018-08-30 12:18:23,889 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:23,914 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:18:23,915 p=14044 u=mistral | Thursday 30 August 2018 12:18:23 -0400 (0:00:00.066) 0:04:43.694 ******* >2018-08-30 12:18:23,961 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:18:23,976 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:18:23,992 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:18:24,007 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:18:24,023 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:18:24,040 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:18:24,057 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:18:24,058 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.142) 0:04:43.837 ******* >2018-08-30 12:18:24,109 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:24,126 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/etc/ceph/ceph.mon.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:24,143 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:24,156 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:24,172 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:24,191 p=14044 u=mistral | skipping: [172.16.0.33] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:24,210 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:18:24,210 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.152) 0:04:43.989 ******* >2018-08-30 12:18:24,236 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,250 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:18:24,250 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.040) 0:04:44.030 ******* >2018-08-30 12:18:24,276 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,290 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:18:24,291 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.040) 0:04:44.070 ******* >2018-08-30 12:18:24,338 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,355 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:18:24,355 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.064) 0:04:44.134 ******* >2018-08-30 12:18:24,393 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,406 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:18:24,407 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.051) 0:04:44.186 ******* >2018-08-30 12:18:24,443 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,458 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:18:24,458 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.050) 0:04:44.237 ******* >2018-08-30 12:18:24,490 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,505 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:18:24,506 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.047) 0:04:44.285 ******* >2018-08-30 12:18:24,541 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,558 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:18:24,558 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.052) 0:04:44.338 ******* >2018-08-30 12:18:24,586 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:24,600 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:18:24,600 p=14044 u=mistral | Thursday 30 August 2018 12:18:24 -0400 (0:00:00.041) 0:04:44.379 ******* >2018-08-30 12:18:25,019 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:25,042 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:18:25,042 p=14044 u=mistral | Thursday 30 August 2018 12:18:25 -0400 (0:00:00.441) 0:04:44.821 ******* >2018-08-30 12:18:25,079 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:25,098 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:18:25,098 p=14044 u=mistral | Thursday 30 August 2018 12:18:25 -0400 (0:00:00.056) 0:04:44.878 ******* >2018-08-30 12:18:25,133 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:25,152 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:18:25,152 p=14044 u=mistral | Thursday 30 August 2018 12:18:25 -0400 (0:00:00.053) 0:04:44.931 ******* >2018-08-30 12:18:25,183 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:25,199 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:18:25,199 p=14044 u=mistral | Thursday 30 August 2018 12:18:25 -0400 (0:00:00.046) 0:04:44.978 ******* >2018-08-30 12:18:25,586 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:25,612 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:18:25,612 p=14044 u=mistral | Thursday 30 August 2018 12:18:25 -0400 (0:00:00.412) 0:04:45.391 ******* >2018-08-30 12:18:25,643 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:25,664 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:18:25,665 p=14044 u=mistral | Thursday 30 August 2018 12:18:25 -0400 (0:00:00.052) 0:04:45.444 ******* >2018-08-30 12:18:25,698 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:25,716 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:18:25,717 p=14044 u=mistral | Thursday 30 August 2018 12:18:25 -0400 (0:00:00.051) 0:04:45.496 ******* >2018-08-30 12:18:26,079 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:26,110 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:18:26,110 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.393) 0:04:45.889 ******* >2018-08-30 12:18:26,140 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:26,155 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:18:26,155 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.044) 0:04:45.934 ******* >2018-08-30 12:18:26,190 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:26,206 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:18:26,207 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.051) 0:04:45.986 ******* >2018-08-30 12:18:26,238 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:26,255 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:18:26,255 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.048) 0:04:46.034 ******* >2018-08-30 12:18:26,685 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:26,717 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:18:26,718 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.462) 0:04:46.497 ******* >2018-08-30 12:18:26,750 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:26,765 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:18:26,766 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.047) 0:04:46.545 ******* >2018-08-30 12:18:26,804 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:26,825 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:18:26,825 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.059) 0:04:46.604 ******* >2018-08-30 12:18:26,900 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:26,914 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:18:26,915 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.089) 0:04:46.694 ******* >2018-08-30 12:18:26,946 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:26,961 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:18:26,962 p=14044 u=mistral | Thursday 30 August 2018 12:18:26 -0400 (0:00:00.046) 0:04:46.741 ******* >2018-08-30 12:18:26,991 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:27,005 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:18:27,006 p=14044 u=mistral | Thursday 30 August 2018 12:18:27 -0400 (0:00:00.043) 0:04:46.785 ******* >2018-08-30 12:18:27,036 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:27,050 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:18:27,050 p=14044 u=mistral | Thursday 30 August 2018 12:18:27 -0400 (0:00:00.044) 0:04:46.829 ******* >2018-08-30 12:18:27,118 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:27,134 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:18:27,134 p=14044 u=mistral | Thursday 30 August 2018 12:18:27 -0400 (0:00:00.084) 0:04:46.913 ******* >2018-08-30 12:18:27,164 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:27,180 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:18:27,181 p=14044 u=mistral | Thursday 30 August 2018 12:18:27 -0400 (0:00:00.046) 0:04:46.960 ******* >2018-08-30 12:18:27,214 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:27,234 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:18:27,235 p=14044 u=mistral | Thursday 30 August 2018 12:18:27 -0400 (0:00:00.053) 0:04:47.014 ******* >2018-08-30 12:18:27,642 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:27,660 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:18:27,660 p=14044 u=mistral | Thursday 30 August 2018 12:18:27 -0400 (0:00:00.425) 0:04:47.439 ******* >2018-08-30 12:18:28,020 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:18:28,042 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:18:28,043 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.382) 0:04:47.822 ******* >2018-08-30 12:18:28,112 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:28,129 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:18:28,130 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.086) 0:04:47.909 ******* >2018-08-30 12:18:28,170 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,184 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:18:28,184 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.054) 0:04:47.963 ******* >2018-08-30 12:18:28,215 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,229 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:18:28,230 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.045) 0:04:48.009 ******* >2018-08-30 12:18:28,260 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,274 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:18:28,274 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.044) 0:04:48.053 ******* >2018-08-30 12:18:28,305 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,320 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:18:28,320 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.045) 0:04:48.099 ******* >2018-08-30 12:18:28,358 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,374 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:18:28,375 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.054) 0:04:48.154 ******* >2018-08-30 12:18:28,404 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,418 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:18:28,418 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.043) 0:04:48.197 ******* >2018-08-30 12:18:28,449 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,471 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:18:28,471 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.053) 0:04:48.250 ******* >2018-08-30 12:18:28,502 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,516 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:18:28,517 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.045) 0:04:48.296 ******* >2018-08-30 12:18:28,545 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,559 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:18:28,559 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.042) 0:04:48.339 ******* >2018-08-30 12:18:28,591 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,605 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:18:28,606 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.046) 0:04:48.385 ******* >2018-08-30 12:18:28,642 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:28,656 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:18:28,656 p=14044 u=mistral | Thursday 30 August 2018 12:18:28 -0400 (0:00:00.050) 0:04:48.435 ******* >2018-08-30 12:18:29,753 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:29,772 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:18:29,772 p=14044 u=mistral | Thursday 30 August 2018 12:18:29 -0400 (0:00:01.116) 0:04:49.551 ******* >2018-08-30 12:18:29,839 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:29,860 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:18:29,861 p=14044 u=mistral | Thursday 30 August 2018 12:18:29 -0400 (0:00:00.088) 0:04:49.640 ******* >2018-08-30 12:18:29,896 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:29,912 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:18:29,912 p=14044 u=mistral | Thursday 30 August 2018 12:18:29 -0400 (0:00:00.051) 0:04:49.692 ******* >2018-08-30 12:18:29,943 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:29,958 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:18:29,958 p=14044 u=mistral | Thursday 30 August 2018 12:18:29 -0400 (0:00:00.045) 0:04:49.737 ******* >2018-08-30 12:18:30,027 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:30,041 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:18:30,042 p=14044 u=mistral | Thursday 30 August 2018 12:18:30 -0400 (0:00:00.083) 0:04:49.821 ******* >2018-08-30 12:18:30,073 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:30,087 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:18:30,087 p=14044 u=mistral | Thursday 30 August 2018 12:18:30 -0400 (0:00:00.045) 0:04:49.866 ******* >2018-08-30 12:18:30,115 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:30,129 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:18:30,129 p=14044 u=mistral | Thursday 30 August 2018 12:18:30 -0400 (0:00:00.042) 0:04:49.908 ******* >2018-08-30 12:18:30,473 p=14044 u=mistral | changed: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:18:30,760 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:18:31,042 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:18:31,340 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:18:31,634 p=14044 u=mistral | changed: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:18:31,653 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:18:31,654 p=14044 u=mistral | Thursday 30 August 2018 12:18:31 -0400 (0:00:01.524) 0:04:51.433 ******* >2018-08-30 12:18:31,682 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:31,699 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:18:31,700 p=14044 u=mistral | Thursday 30 August 2018 12:18:31 -0400 (0:00:00.045) 0:04:51.479 ******* >2018-08-30 12:18:31,730 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:31,750 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:18:31,751 p=14044 u=mistral | Thursday 30 August 2018 12:18:31 -0400 (0:00:00.051) 0:04:51.530 ******* >2018-08-30 12:18:32,021 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:18:32,043 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:18:32,044 p=14044 u=mistral | Thursday 30 August 2018 12:18:32 -0400 (0:00:00.292) 0:04:51.823 ******* >2018-08-30 12:18:32,074 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:32,095 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:18:32,096 p=14044 u=mistral | Thursday 30 August 2018 12:18:32 -0400 (0:00:00.051) 0:04:51.875 ******* >2018-08-30 12:18:32,122 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:32,138 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:18:32,138 p=14044 u=mistral | Thursday 30 August 2018 12:18:32 -0400 (0:00:00.042) 0:04:51.917 ******* >2018-08-30 12:18:32,454 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:18:32,471 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:18:32,472 p=14044 u=mistral | Thursday 30 August 2018 12:18:32 -0400 (0:00:00.333) 0:04:52.251 ******* >2018-08-30 12:18:33,265 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:33,281 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:18:33,281 p=14044 u=mistral | Thursday 30 August 2018 12:18:33 -0400 (0:00:00.809) 0:04:53.060 ******* >2018-08-30 12:18:33,309 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:33,322 p=14044 u=mistral | TASK [ceph-mgr : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:18:33,323 p=14044 u=mistral | Thursday 30 August 2018 12:18:33 -0400 (0:00:00.041) 0:04:53.102 ******* >2018-08-30 12:18:33,429 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:33,443 p=14044 u=mistral | TASK [ceph-mgr : create mgr directory] ***************************************** >2018-08-30 12:18:33,443 p=14044 u=mistral | Thursday 30 August 2018 12:18:33 -0400 (0:00:00.120) 0:04:53.223 ******* >2018-08-30 12:18:33,775 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:33,791 p=14044 u=mistral | TASK [ceph-mgr : copy ceph keyring(s) if needed] ******************************* >2018-08-30 12:18:33,792 p=14044 u=mistral | Thursday 30 August 2018 12:18:33 -0400 (0:00:00.348) 0:04:53.571 ******* >2018-08-30 12:18:34,472 p=14044 u=mistral | ok: [172.16.0.33] => (item={u'dest': u'/var/lib/ceph/mgr/ceph-lab-controller03/keyring', u'name': u'/etc/ceph/ceph.mgr.lab-controller03.keyring', u'copy_key': True}) >2018-08-30 12:18:34,487 p=14044 u=mistral | skipping: [172.16.0.33] => (item={u'dest': u'/etc/ceph/ceph.client.admin.keyring', u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:18:34,502 p=14044 u=mistral | TASK [ceph-mgr : set mgr key permissions] ************************************** >2018-08-30 12:18:34,503 p=14044 u=mistral | Thursday 30 August 2018 12:18:34 -0400 (0:00:00.710) 0:04:54.282 ******* >2018-08-30 12:18:34,861 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:34,875 p=14044 u=mistral | TASK [ceph-mgr : install ceph-mgr package on RedHat or SUSE] ******************* >2018-08-30 12:18:34,876 p=14044 u=mistral | Thursday 30 August 2018 12:18:34 -0400 (0:00:00.372) 0:04:54.655 ******* >2018-08-30 12:18:34,915 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:34,932 p=14044 u=mistral | TASK [ceph-mgr : install ceph mgr for debian] ********************************** >2018-08-30 12:18:34,933 p=14044 u=mistral | Thursday 30 August 2018 12:18:34 -0400 (0:00:00.057) 0:04:54.712 ******* >2018-08-30 12:18:34,965 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:34,980 p=14044 u=mistral | TASK [ceph-mgr : ensure systemd service override directory exists] ************* >2018-08-30 12:18:34,981 p=14044 u=mistral | Thursday 30 August 2018 12:18:34 -0400 (0:00:00.047) 0:04:54.760 ******* >2018-08-30 12:18:35,015 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:35,030 p=14044 u=mistral | TASK [ceph-mgr : add ceph-mgr systemd service overrides] *********************** >2018-08-30 12:18:35,030 p=14044 u=mistral | Thursday 30 August 2018 12:18:35 -0400 (0:00:00.049) 0:04:54.809 ******* >2018-08-30 12:18:35,071 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:35,087 p=14044 u=mistral | TASK [ceph-mgr : start and add that the mgr service to the init sequence] ****** >2018-08-30 12:18:35,087 p=14044 u=mistral | Thursday 30 August 2018 12:18:35 -0400 (0:00:00.056) 0:04:54.866 ******* >2018-08-30 12:18:35,123 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:35,137 p=14044 u=mistral | TASK [ceph-mgr : generate systemd unit file] *********************************** >2018-08-30 12:18:35,138 p=14044 u=mistral | Thursday 30 August 2018 12:18:35 -0400 (0:00:00.050) 0:04:54.917 ******* >2018-08-30 12:18:35,857 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:35,872 p=14044 u=mistral | TASK [ceph-mgr : systemd start mgr container] ********************************** >2018-08-30 12:18:35,873 p=14044 u=mistral | Thursday 30 August 2018 12:18:35 -0400 (0:00:00.734) 0:04:55.652 ******* >2018-08-30 12:18:36,422 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:36,451 p=14044 u=mistral | TASK [ceph-mgr : get enabled modules from ceph-mgr] **************************** >2018-08-30 12:18:36,451 p=14044 u=mistral | Thursday 30 August 2018 12:18:36 -0400 (0:00:00.578) 0:04:56.231 ******* >2018-08-30 12:18:37,314 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:18:37,330 p=14044 u=mistral | TASK [ceph-mgr : set _ceph_mgr_modules fact] *********************************** >2018-08-30 12:18:37,330 p=14044 u=mistral | Thursday 30 August 2018 12:18:37 -0400 (0:00:00.878) 0:04:57.110 ******* >2018-08-30 12:18:37,408 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:18:37,442 p=14044 u=mistral | TASK [ceph-mgr : disable ceph mgr enabled modules] ***************************** >2018-08-30 12:18:37,442 p=14044 u=mistral | Thursday 30 August 2018 12:18:37 -0400 (0:00:00.111) 0:04:57.221 ******* >2018-08-30 12:18:37,488 p=14044 u=mistral | skipping: [172.16.0.33] => (item=status) >2018-08-30 12:18:37,520 p=14044 u=mistral | TASK [ceph-mgr : add modules to ceph-mgr] ************************************** >2018-08-30 12:18:37,520 p=14044 u=mistral | Thursday 30 August 2018 12:18:37 -0400 (0:00:00.078) 0:04:57.300 ******* >2018-08-30 12:18:37,567 p=14044 u=mistral | skipping: [172.16.0.33] => (item=status) >2018-08-30 12:18:37,584 p=14044 u=mistral | TASK [start ceph mgr] ********************************************************** >2018-08-30 12:18:37,584 p=14044 u=mistral | Thursday 30 August 2018 12:18:37 -0400 (0:00:00.063) 0:04:57.363 ******* >2018-08-30 12:18:37,614 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:18:37,629 p=14044 u=mistral | TASK [restart containerized ceph mgr] ****************************************** >2018-08-30 12:18:37,630 p=14044 u=mistral | Thursday 30 August 2018 12:18:37 -0400 (0:00:00.045) 0:04:57.409 ******* >2018-08-30 12:18:38,677 p=14044 u=mistral | changed: [172.16.0.33] >2018-08-30 12:18:38,697 p=14044 u=mistral | PLAY [upgrade ceph mgr node] *************************************************** >2018-08-30 12:18:38,849 p=14044 u=mistral | TASK [non container - get current fsid] **************************************** >2018-08-30 12:18:38,849 p=14044 u=mistral | Thursday 30 August 2018 12:18:38 -0400 (0:00:01.218) 0:04:58.628 ******* >2018-08-30 12:18:38,878 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:38,919 p=14044 u=mistral | TASK [container - get current fsid] ******************************************** >2018-08-30 12:18:38,919 p=14044 u=mistral | Thursday 30 August 2018 12:18:38 -0400 (0:00:00.070) 0:04:58.698 ******* >2018-08-30 12:18:39,837 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:18:39,854 p=14044 u=mistral | TASK [set_fact ceph_cluster_fsid] ********************************************** >2018-08-30 12:18:39,855 p=14044 u=mistral | Thursday 30 August 2018 12:18:39 -0400 (0:00:00.935) 0:04:59.634 ******* >2018-08-30 12:18:39,919 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:39,961 p=14044 u=mistral | TASK [non container | create ceph mgr keyring(s)] ****************************** >2018-08-30 12:18:39,961 p=14044 u=mistral | Thursday 30 August 2018 12:18:39 -0400 (0:00:00.106) 0:04:59.741 ******* >2018-08-30 12:18:39,996 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:18:40,003 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:18:40,011 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:18:40,047 p=14044 u=mistral | TASK [container | create ceph mgr keyring(s)] ********************************** >2018-08-30 12:18:40,047 p=14044 u=mistral | Thursday 30 August 2018 12:18:40 -0400 (0:00:00.085) 0:04:59.826 ******* >2018-08-30 12:18:40,079 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ groups.get(mgr_group_name, []) | length > 0 >}} > >2018-08-30 12:18:40,436 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:18:40,814 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:18:41,179 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:18:41,212 p=14044 u=mistral | TASK [fetch ceph mgr key(s)] *************************************************** >2018-08-30 12:18:41,213 p=14044 u=mistral | Thursday 30 August 2018 12:18:41 -0400 (0:00:01.165) 0:05:00.992 ******* >2018-08-30 12:18:41,561 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:18:41,852 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:18:42,339 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:18:42,353 p=14044 u=mistral | TASK [stop ceph mgr] *********************************************************** >2018-08-30 12:18:42,353 p=14044 u=mistral | Thursday 30 August 2018 12:18:42 -0400 (0:00:01.140) 0:05:02.132 ******* >2018-08-30 12:18:42,379 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:42,393 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:18:42,393 p=14044 u=mistral | Thursday 30 August 2018 12:18:42 -0400 (0:00:00.040) 0:05:02.173 ******* >2018-08-30 12:18:42,774 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:42,790 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:18:42,790 p=14044 u=mistral | Thursday 30 August 2018 12:18:42 -0400 (0:00:00.396) 0:05:02.569 ******* >2018-08-30 12:18:42,821 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:42,838 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:18:42,838 p=14044 u=mistral | Thursday 30 August 2018 12:18:42 -0400 (0:00:00.048) 0:05:02.618 ******* >2018-08-30 12:18:42,871 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:42,886 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:18:42,887 p=14044 u=mistral | Thursday 30 August 2018 12:18:42 -0400 (0:00:00.048) 0:05:02.666 ******* >2018-08-30 12:18:42,930 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:42,948 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:18:42,948 p=14044 u=mistral | Thursday 30 August 2018 12:18:42 -0400 (0:00:00.061) 0:05:02.728 ******* >2018-08-30 12:18:43,331 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:43,353 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:18:43,354 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.405) 0:05:03.133 ******* >2018-08-30 12:18:43,386 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,408 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:18:43,408 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.054) 0:05:03.187 ******* >2018-08-30 12:18:43,441 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,460 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:18:43,460 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.052) 0:05:03.240 ******* >2018-08-30 12:18:43,493 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,507 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:18:43,507 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.046) 0:05:03.286 ******* >2018-08-30 12:18:43,540 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,554 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:18:43,555 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.047) 0:05:03.334 ******* >2018-08-30 12:18:43,584 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,599 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:18:43,599 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.044) 0:05:03.378 ******* >2018-08-30 12:18:43,630 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,645 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:18:43,646 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.046) 0:05:03.425 ******* >2018-08-30 12:18:43,674 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,689 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:18:43,689 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.043) 0:05:03.469 ******* >2018-08-30 12:18:43,721 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,737 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:18:43,737 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.047) 0:05:03.516 ******* >2018-08-30 12:18:43,765 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,780 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:18:43,781 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.043) 0:05:03.560 ******* >2018-08-30 12:18:43,813 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,832 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:18:43,833 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.051) 0:05:03.612 ******* >2018-08-30 12:18:43,866 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,881 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:18:43,881 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.048) 0:05:03.661 ******* >2018-08-30 12:18:43,916 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,930 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:18:43,931 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.049) 0:05:03.710 ******* >2018-08-30 12:18:43,956 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:43,971 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:18:43,971 p=14044 u=mistral | Thursday 30 August 2018 12:18:43 -0400 (0:00:00.040) 0:05:03.750 ******* >2018-08-30 12:18:44,001 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,015 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:18:44,016 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.044) 0:05:03.795 ******* >2018-08-30 12:18:44,053 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,068 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:18:44,068 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.052) 0:05:03.847 ******* >2018-08-30 12:18:44,102 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,115 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:18:44,115 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.046) 0:05:03.894 ******* >2018-08-30 12:18:44,145 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,159 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:18:44,159 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.043) 0:05:03.938 ******* >2018-08-30 12:18:44,194 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,208 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:18:44,209 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.049) 0:05:03.988 ******* >2018-08-30 12:18:44,238 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,256 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:18:44,256 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.047) 0:05:04.035 ******* >2018-08-30 12:18:44,290 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,310 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:18:44,310 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.054) 0:05:04.089 ******* >2018-08-30 12:18:44,339 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,360 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:18:44,361 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.050) 0:05:04.140 ******* >2018-08-30 12:18:44,392 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,409 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:18:44,409 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.048) 0:05:04.189 ******* >2018-08-30 12:18:44,441 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,455 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:18:44,455 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.045) 0:05:04.234 ******* >2018-08-30 12:18:44,751 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:44,765 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:18:44,765 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.310) 0:05:04.544 ******* >2018-08-30 12:18:44,834 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:44,848 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:18:44,849 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.083) 0:05:04.628 ******* >2018-08-30 12:18:44,913 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:44,927 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:18:44,927 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.078) 0:05:04.707 ******* >2018-08-30 12:18:44,949 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:44,977 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:18:44,978 p=14044 u=mistral | Thursday 30 August 2018 12:18:44 -0400 (0:00:00.050) 0:05:04.757 ******* >2018-08-30 12:18:45,071 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:18:45,100 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:18:45,100 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.122) 0:05:04.879 ******* >2018-08-30 12:18:45,127 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:45,151 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:18:45,151 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.051) 0:05:04.930 ******* >2018-08-30 12:18:45,384 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:18:45,399 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:18:45,399 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.247) 0:05:05.178 ******* >2018-08-30 12:18:45,459 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:45,484 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:18:45,484 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.085) 0:05:05.264 ******* >2018-08-30 12:18:45,725 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:18:45,740 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:18:45,740 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.255) 0:05:05.519 ******* >2018-08-30 12:18:45,769 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:45,783 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:18:45,783 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.043) 0:05:05.563 ******* >2018-08-30 12:18:45,845 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:45,866 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:18:45,867 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.083) 0:05:05.646 ******* >2018-08-30 12:18:45,888 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:45,908 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:18:45,908 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.041) 0:05:05.687 ******* >2018-08-30 12:18:45,937 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:45,958 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:18:45,959 p=14044 u=mistral | Thursday 30 August 2018 12:18:45 -0400 (0:00:00.050) 0:05:05.738 ******* >2018-08-30 12:18:45,986 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,001 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:18:46,001 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.042) 0:05:05.781 ******* >2018-08-30 12:18:46,026 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,041 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:18:46,041 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.039) 0:05:05.820 ******* >2018-08-30 12:18:46,107 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:46,121 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:18:46,121 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.079) 0:05:05.900 ******* >2018-08-30 12:18:46,156 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,170 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:18:46,171 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.049) 0:05:05.950 ******* >2018-08-30 12:18:46,203 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,216 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:18:46,216 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.045) 0:05:05.996 ******* >2018-08-30 12:18:46,244 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,262 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:18:46,263 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.046) 0:05:06.042 ******* >2018-08-30 12:18:46,294 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,308 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:18:46,308 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.045) 0:05:06.087 ******* >2018-08-30 12:18:46,347 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/dev/vdb) >2018-08-30 12:18:46,361 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:18:46,361 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.053) 0:05:06.140 ******* >2018-08-30 12:18:46,397 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:18:46,411 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:18:46,411 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.049) 0:05:06.190 ******* >2018-08-30 12:18:46,435 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,448 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:18:46,448 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.037) 0:05:06.228 ******* >2018-08-30 12:18:46,477 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,491 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:18:46,492 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.042) 0:05:06.271 ******* >2018-08-30 12:18:46,520 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,535 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:18:46,535 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.043) 0:05:06.314 ******* >2018-08-30 12:18:46,563 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,578 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:18:46,579 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.043) 0:05:06.358 ******* >2018-08-30 12:18:46,604 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:46,620 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:18:46,621 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.042) 0:05:06.400 ******* >2018-08-30 12:18:46,676 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:46,690 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:18:46,690 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.069) 0:05:06.469 ******* >2018-08-30 12:18:46,740 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:46,757 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:18:46,757 p=14044 u=mistral | Thursday 30 August 2018 12:18:46 -0400 (0:00:00.066) 0:05:06.536 ******* >2018-08-30 12:18:47,090 p=14044 u=mistral | ok: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:18:47,382 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/) >2018-08-30 12:18:47,683 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mon) >2018-08-30 12:18:48,162 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/osd) >2018-08-30 12:18:48,442 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mds) >2018-08-30 12:18:48,717 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/tmp) >2018-08-30 12:18:48,992 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:18:49,273 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:18:49,558 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:18:49,846 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:18:50,134 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:18:50,412 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:18:50,435 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:18:50,435 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:03.678) 0:05:10.215 ******* >2018-08-30 12:18:50,468 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,483 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:18:50,484 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.048) 0:05:10.263 ******* >2018-08-30 12:18:50,514 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,529 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:18:50,529 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.045) 0:05:10.309 ******* >2018-08-30 12:18:50,557 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,571 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:18:50,572 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.042) 0:05:10.351 ******* >2018-08-30 12:18:50,602 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,616 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:18:50,617 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.045) 0:05:10.396 ******* >2018-08-30 12:18:50,643 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,666 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:18:50,666 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.049) 0:05:10.445 ******* >2018-08-30 12:18:50,693 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,713 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:18:50,714 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.047) 0:05:10.493 ******* >2018-08-30 12:18:50,741 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,756 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:18:50,757 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.042) 0:05:10.536 ******* >2018-08-30 12:18:50,783 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,799 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:18:50,800 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.042) 0:05:10.579 ******* >2018-08-30 12:18:50,827 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,842 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:18:50,842 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.042) 0:05:10.621 ******* >2018-08-30 12:18:50,870 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,884 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:18:50,885 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.042) 0:05:10.664 ******* >2018-08-30 12:18:50,914 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,928 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:18:50,929 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.043) 0:05:10.708 ******* >2018-08-30 12:18:50,957 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:50,972 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:18:50,972 p=14044 u=mistral | Thursday 30 August 2018 12:18:50 -0400 (0:00:00.043) 0:05:10.751 ******* >2018-08-30 12:18:51,002 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,016 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:18:51,016 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.044) 0:05:10.796 ******* >2018-08-30 12:18:51,044 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,058 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:18:51,058 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.041) 0:05:10.837 ******* >2018-08-30 12:18:51,090 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,105 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:18:51,105 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.046) 0:05:10.884 ******* >2018-08-30 12:18:51,136 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,151 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:18:51,152 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.046) 0:05:10.931 ******* >2018-08-30 12:18:51,180 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,196 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:18:51,197 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.045) 0:05:10.976 ******* >2018-08-30 12:18:51,224 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,239 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:18:51,239 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.042) 0:05:11.018 ******* >2018-08-30 12:18:51,266 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,281 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:18:51,281 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.042) 0:05:11.061 ******* >2018-08-30 12:18:51,311 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,329 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:18:51,329 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.047) 0:05:11.109 ******* >2018-08-30 12:18:51,360 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,377 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:18:51,378 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.048) 0:05:11.157 ******* >2018-08-30 12:18:51,409 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,426 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:18:51,426 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.048) 0:05:11.205 ******* >2018-08-30 12:18:51,454 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,469 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:18:51,469 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.043) 0:05:11.248 ******* >2018-08-30 12:18:51,506 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,522 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:18:51,523 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.053) 0:05:11.302 ******* >2018-08-30 12:18:51,557 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,573 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:18:51,573 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.050) 0:05:11.352 ******* >2018-08-30 12:18:51,613 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,627 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:18:51,628 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.054) 0:05:11.407 ******* >2018-08-30 12:18:51,658 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,674 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-controller01/keyring already exists] *** >2018-08-30 12:18:51,675 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.046) 0:05:11.454 ******* >2018-08-30 12:18:51,704 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,720 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-controller01/keyring doesn't exist] *** >2018-08-30 12:18:51,720 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.045) 0:05:11.499 ******* >2018-08-30 12:18:51,752 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,768 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:18:51,768 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.047) 0:05:11.547 ******* >2018-08-30 12:18:51,800 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,814 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:18:51,814 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.046) 0:05:11.594 ******* >2018-08-30 12:18:51,842 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,855 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:18:51,856 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.041) 0:05:11.635 ******* >2018-08-30 12:18:51,883 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,905 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:18:51,906 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.050) 0:05:11.685 ******* >2018-08-30 12:18:51,935 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,950 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:18:51,951 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.044) 0:05:11.730 ******* >2018-08-30 12:18:51,980 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:51,994 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:18:51,994 p=14044 u=mistral | Thursday 30 August 2018 12:18:51 -0400 (0:00:00.043) 0:05:11.773 ******* >2018-08-30 12:18:52,038 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:18:52,045 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/log/ceph) >2018-08-30 12:18:52,060 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:18:52,060 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.065) 0:05:11.839 ******* >2018-08-30 12:18:52,090 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,104 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:18:52,104 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.044) 0:05:11.883 ******* >2018-08-30 12:18:52,135 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,149 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:18:52,149 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.045) 0:05:11.929 ******* >2018-08-30 12:18:52,182 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,194 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:18:52,194 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.044) 0:05:11.973 ******* >2018-08-30 12:18:52,221 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,235 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:18:52,235 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.040) 0:05:12.014 ******* >2018-08-30 12:18:52,268 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,283 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:18:52,283 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.048) 0:05:12.062 ******* >2018-08-30 12:18:52,319 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,333 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:18:52,333 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.050) 0:05:12.112 ******* >2018-08-30 12:18:52,368 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,382 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:18:52,382 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.049) 0:05:12.161 ******* >2018-08-30 12:18:52,436 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,451 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:18:52,451 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.069) 0:05:12.231 ******* >2018-08-30 12:18:52,483 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:52,499 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:18:52,499 p=14044 u=mistral | Thursday 30 August 2018 12:18:52 -0400 (0:00:00.047) 0:05:12.278 ******* >2018-08-30 12:18:52,839 p=14044 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:18:53,138 p=14044 u=mistral | ok: [172.16.0.24] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:18:53,156 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:18:53,156 p=14044 u=mistral | Thursday 30 August 2018 12:18:53 -0400 (0:00:00.656) 0:05:12.935 ******* >2018-08-30 12:18:53,227 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:53,245 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:18:53,245 p=14044 u=mistral | Thursday 30 August 2018 12:18:53 -0400 (0:00:00.088) 0:05:13.024 ******* >2018-08-30 12:18:53,271 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:53,294 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:18:53,294 p=14044 u=mistral | Thursday 30 August 2018 12:18:53 -0400 (0:00:00.049) 0:05:13.073 ******* >2018-08-30 12:18:53,657 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:53,674 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:18:53,674 p=14044 u=mistral | Thursday 30 August 2018 12:18:53 -0400 (0:00:00.380) 0:05:13.454 ******* >2018-08-30 12:18:53,737 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:53,755 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:18:53,755 p=14044 u=mistral | Thursday 30 August 2018 12:18:53 -0400 (0:00:00.080) 0:05:13.534 ******* >2018-08-30 12:18:54,140 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:54,156 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:18:54,156 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.400) 0:05:13.935 ******* >2018-08-30 12:18:54,196 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:54,212 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:18:54,212 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.056) 0:05:13.991 ******* >2018-08-30 12:18:54,262 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.33) >2018-08-30 12:18:54,282 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.24) >2018-08-30 12:18:54,304 p=14044 u=mistral | skipping: [172.16.0.24] => (item=172.16.0.25) >2018-08-30 12:18:54,324 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:18:54,324 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.111) 0:05:14.103 ******* >2018-08-30 12:18:54,364 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:54,380 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:18:54,380 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.056) 0:05:14.160 ******* >2018-08-30 12:18:54,428 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:54,452 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:18:54,452 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.071) 0:05:14.231 ******* >2018-08-30 12:18:54,497 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:18:54,512 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:18:54,535 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:18:54,552 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:18:54,569 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:18:54,587 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:18:54,607 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:18:54,607 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.155) 0:05:14.386 ******* >2018-08-30 12:18:54,675 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:54,703 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/etc/ceph/ceph.mon.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:54,723 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:54,738 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:54,758 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:54,776 p=14044 u=mistral | skipping: [172.16.0.24] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:18:54,801 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:18:54,802 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.194) 0:05:14.581 ******* >2018-08-30 12:18:54,828 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:54,842 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:18:54,843 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.040) 0:05:14.622 ******* >2018-08-30 12:18:54,871 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:54,888 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:18:54,889 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.045) 0:05:14.668 ******* >2018-08-30 12:18:54,930 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:54,956 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:18:54,957 p=14044 u=mistral | Thursday 30 August 2018 12:18:54 -0400 (0:00:00.068) 0:05:14.736 ******* >2018-08-30 12:18:54,995 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,010 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:18:55,010 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.053) 0:05:14.790 ******* >2018-08-30 12:18:55,047 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,061 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:18:55,062 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.050) 0:05:14.840 ******* >2018-08-30 12:18:55,096 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,111 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:18:55,112 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.049) 0:05:14.891 ******* >2018-08-30 12:18:55,145 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,160 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:18:55,160 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.048) 0:05:14.940 ******* >2018-08-30 12:18:55,195 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,212 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:18:55,212 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.051) 0:05:14.991 ******* >2018-08-30 12:18:55,631 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:55,654 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:18:55,654 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.442) 0:05:15.434 ******* >2018-08-30 12:18:55,685 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,705 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:18:55,705 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.051) 0:05:15.485 ******* >2018-08-30 12:18:55,738 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,760 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:18:55,761 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.055) 0:05:15.540 ******* >2018-08-30 12:18:55,792 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:55,808 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:18:55,808 p=14044 u=mistral | Thursday 30 August 2018 12:18:55 -0400 (0:00:00.047) 0:05:15.587 ******* >2018-08-30 12:18:56,227 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:56,249 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:18:56,250 p=14044 u=mistral | Thursday 30 August 2018 12:18:56 -0400 (0:00:00.441) 0:05:16.029 ******* >2018-08-30 12:18:56,277 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:56,291 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:18:56,292 p=14044 u=mistral | Thursday 30 August 2018 12:18:56 -0400 (0:00:00.041) 0:05:16.071 ******* >2018-08-30 12:18:56,322 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:56,337 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:18:56,337 p=14044 u=mistral | Thursday 30 August 2018 12:18:56 -0400 (0:00:00.045) 0:05:16.117 ******* >2018-08-30 12:18:56,758 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:56,777 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:18:56,778 p=14044 u=mistral | Thursday 30 August 2018 12:18:56 -0400 (0:00:00.440) 0:05:16.557 ******* >2018-08-30 12:18:56,805 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:56,822 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:18:56,822 p=14044 u=mistral | Thursday 30 August 2018 12:18:56 -0400 (0:00:00.044) 0:05:16.601 ******* >2018-08-30 12:18:56,849 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:56,863 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:18:56,863 p=14044 u=mistral | Thursday 30 August 2018 12:18:56 -0400 (0:00:00.041) 0:05:16.642 ******* >2018-08-30 12:18:56,889 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:56,909 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:18:56,909 p=14044 u=mistral | Thursday 30 August 2018 12:18:56 -0400 (0:00:00.046) 0:05:16.688 ******* >2018-08-30 12:18:57,373 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:57,394 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:18:57,394 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.485) 0:05:17.174 ******* >2018-08-30 12:18:57,427 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:57,453 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:18:57,453 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.058) 0:05:17.232 ******* >2018-08-30 12:18:57,485 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:57,500 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:18:57,501 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.047) 0:05:17.280 ******* >2018-08-30 12:18:57,569 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:57,585 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:18:57,585 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.084) 0:05:17.364 ******* >2018-08-30 12:18:57,613 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:57,636 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:18:57,637 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.051) 0:05:17.416 ******* >2018-08-30 12:18:57,668 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:57,683 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:18:57,683 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.046) 0:05:17.462 ******* >2018-08-30 12:18:57,714 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:57,728 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:18:57,729 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.045) 0:05:17.508 ******* >2018-08-30 12:18:57,804 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:57,820 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:18:57,821 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.091) 0:05:17.600 ******* >2018-08-30 12:18:57,852 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:57,867 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:18:57,868 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.046) 0:05:17.647 ******* >2018-08-30 12:18:57,910 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:57,934 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:18:57,934 p=14044 u=mistral | Thursday 30 August 2018 12:18:57 -0400 (0:00:00.066) 0:05:17.714 ******* >2018-08-30 12:18:58,352 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:58,378 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:18:58,378 p=14044 u=mistral | Thursday 30 August 2018 12:18:58 -0400 (0:00:00.443) 0:05:18.157 ******* >2018-08-30 12:18:58,794 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:18:58,814 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:18:58,815 p=14044 u=mistral | Thursday 30 August 2018 12:18:58 -0400 (0:00:00.436) 0:05:18.594 ******* >2018-08-30 12:18:58,896 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:18:58,911 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:18:58,912 p=14044 u=mistral | Thursday 30 August 2018 12:18:58 -0400 (0:00:00.096) 0:05:18.691 ******* >2018-08-30 12:18:58,963 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:58,986 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:18:58,986 p=14044 u=mistral | Thursday 30 August 2018 12:18:58 -0400 (0:00:00.074) 0:05:18.765 ******* >2018-08-30 12:18:59,021 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,043 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:18:59,043 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.056) 0:05:18.822 ******* >2018-08-30 12:18:59,081 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,103 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:18:59,103 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.059) 0:05:18.882 ******* >2018-08-30 12:18:59,134 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,149 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:18:59,150 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.046) 0:05:18.929 ******* >2018-08-30 12:18:59,187 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,203 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:18:59,203 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.053) 0:05:18.982 ******* >2018-08-30 12:18:59,234 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,248 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:18:59,249 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.045) 0:05:19.028 ******* >2018-08-30 12:18:59,283 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,306 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:18:59,306 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.057) 0:05:19.085 ******* >2018-08-30 12:18:59,338 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,360 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:18:59,360 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.053) 0:05:19.139 ******* >2018-08-30 12:18:59,392 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,406 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:18:59,407 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.046) 0:05:19.186 ******* >2018-08-30 12:18:59,447 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,462 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:18:59,462 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.055) 0:05:19.241 ******* >2018-08-30 12:18:59,494 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:18:59,509 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:18:59,509 p=14044 u=mistral | Thursday 30 August 2018 12:18:59 -0400 (0:00:00.047) 0:05:19.289 ******* >2018-08-30 12:19:00,658 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:00,672 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:19:00,672 p=14044 u=mistral | Thursday 30 August 2018 12:19:00 -0400 (0:00:01.162) 0:05:20.452 ******* >2018-08-30 12:19:00,745 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:00,765 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:19:00,766 p=14044 u=mistral | Thursday 30 August 2018 12:19:00 -0400 (0:00:00.093) 0:05:20.545 ******* >2018-08-30 12:19:00,797 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:00,811 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:19:00,811 p=14044 u=mistral | Thursday 30 August 2018 12:19:00 -0400 (0:00:00.045) 0:05:20.590 ******* >2018-08-30 12:19:00,843 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:00,858 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:19:00,858 p=14044 u=mistral | Thursday 30 August 2018 12:19:00 -0400 (0:00:00.047) 0:05:20.638 ******* >2018-08-30 12:19:00,919 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:00,940 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:19:00,940 p=14044 u=mistral | Thursday 30 August 2018 12:19:00 -0400 (0:00:00.081) 0:05:20.719 ******* >2018-08-30 12:19:00,971 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:00,991 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:19:00,991 p=14044 u=mistral | Thursday 30 August 2018 12:19:00 -0400 (0:00:00.050) 0:05:20.770 ******* >2018-08-30 12:19:01,034 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:01,049 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:19:01,049 p=14044 u=mistral | Thursday 30 August 2018 12:19:01 -0400 (0:00:00.058) 0:05:20.828 ******* >2018-08-30 12:19:01,461 p=14044 u=mistral | changed: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:19:01,774 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:19:02,065 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:19:02,556 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:19:02,862 p=14044 u=mistral | changed: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:19:02,881 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:19:02,882 p=14044 u=mistral | Thursday 30 August 2018 12:19:02 -0400 (0:00:01.832) 0:05:22.661 ******* >2018-08-30 12:19:02,912 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:02,929 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:19:02,929 p=14044 u=mistral | Thursday 30 August 2018 12:19:02 -0400 (0:00:00.046) 0:05:22.708 ******* >2018-08-30 12:19:02,958 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:02,979 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:19:02,979 p=14044 u=mistral | Thursday 30 August 2018 12:19:02 -0400 (0:00:00.050) 0:05:22.758 ******* >2018-08-30 12:19:03,247 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:19:03,268 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:19:03,269 p=14044 u=mistral | Thursday 30 August 2018 12:19:03 -0400 (0:00:00.289) 0:05:23.048 ******* >2018-08-30 12:19:03,302 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:03,322 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:19:03,323 p=14044 u=mistral | Thursday 30 August 2018 12:19:03 -0400 (0:00:00.053) 0:05:23.102 ******* >2018-08-30 12:19:03,348 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:03,361 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:19:03,362 p=14044 u=mistral | Thursday 30 August 2018 12:19:03 -0400 (0:00:00.038) 0:05:23.141 ******* >2018-08-30 12:19:03,672 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:19:03,689 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:19:03,689 p=14044 u=mistral | Thursday 30 August 2018 12:19:03 -0400 (0:00:00.327) 0:05:23.468 ******* >2018-08-30 12:19:04,473 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:04,489 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:19:04,489 p=14044 u=mistral | Thursday 30 August 2018 12:19:04 -0400 (0:00:00.799) 0:05:24.268 ******* >2018-08-30 12:19:04,520 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:04,534 p=14044 u=mistral | TASK [ceph-mgr : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:19:04,535 p=14044 u=mistral | Thursday 30 August 2018 12:19:04 -0400 (0:00:00.045) 0:05:24.314 ******* >2018-08-30 12:19:04,629 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:04,643 p=14044 u=mistral | TASK [ceph-mgr : create mgr directory] ***************************************** >2018-08-30 12:19:04,644 p=14044 u=mistral | Thursday 30 August 2018 12:19:04 -0400 (0:00:00.108) 0:05:24.423 ******* >2018-08-30 12:19:04,992 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:05,006 p=14044 u=mistral | TASK [ceph-mgr : copy ceph keyring(s) if needed] ******************************* >2018-08-30 12:19:05,006 p=14044 u=mistral | Thursday 30 August 2018 12:19:05 -0400 (0:00:00.362) 0:05:24.785 ******* >2018-08-30 12:19:05,742 p=14044 u=mistral | ok: [172.16.0.24] => (item={u'dest': u'/var/lib/ceph/mgr/ceph-lab-controller01/keyring', u'name': u'/etc/ceph/ceph.mgr.lab-controller01.keyring', u'copy_key': True}) >2018-08-30 12:19:05,757 p=14044 u=mistral | skipping: [172.16.0.24] => (item={u'dest': u'/etc/ceph/ceph.client.admin.keyring', u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:19:05,774 p=14044 u=mistral | TASK [ceph-mgr : set mgr key permissions] ************************************** >2018-08-30 12:19:05,774 p=14044 u=mistral | Thursday 30 August 2018 12:19:05 -0400 (0:00:00.767) 0:05:25.553 ******* >2018-08-30 12:19:06,096 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:06,114 p=14044 u=mistral | TASK [ceph-mgr : install ceph-mgr package on RedHat or SUSE] ******************* >2018-08-30 12:19:06,114 p=14044 u=mistral | Thursday 30 August 2018 12:19:06 -0400 (0:00:00.339) 0:05:25.893 ******* >2018-08-30 12:19:06,146 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:06,163 p=14044 u=mistral | TASK [ceph-mgr : install ceph mgr for debian] ********************************** >2018-08-30 12:19:06,163 p=14044 u=mistral | Thursday 30 August 2018 12:19:06 -0400 (0:00:00.049) 0:05:25.943 ******* >2018-08-30 12:19:06,200 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:06,217 p=14044 u=mistral | TASK [ceph-mgr : ensure systemd service override directory exists] ************* >2018-08-30 12:19:06,217 p=14044 u=mistral | Thursday 30 August 2018 12:19:06 -0400 (0:00:00.053) 0:05:25.996 ******* >2018-08-30 12:19:06,251 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:06,264 p=14044 u=mistral | TASK [ceph-mgr : add ceph-mgr systemd service overrides] *********************** >2018-08-30 12:19:06,265 p=14044 u=mistral | Thursday 30 August 2018 12:19:06 -0400 (0:00:00.047) 0:05:26.044 ******* >2018-08-30 12:19:06,299 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:06,313 p=14044 u=mistral | TASK [ceph-mgr : start and add that the mgr service to the init sequence] ****** >2018-08-30 12:19:06,314 p=14044 u=mistral | Thursday 30 August 2018 12:19:06 -0400 (0:00:00.048) 0:05:26.093 ******* >2018-08-30 12:19:06,347 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:06,363 p=14044 u=mistral | TASK [ceph-mgr : generate systemd unit file] *********************************** >2018-08-30 12:19:06,363 p=14044 u=mistral | Thursday 30 August 2018 12:19:06 -0400 (0:00:00.049) 0:05:26.142 ******* >2018-08-30 12:19:07,091 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:07,111 p=14044 u=mistral | TASK [ceph-mgr : systemd start mgr container] ********************************** >2018-08-30 12:19:07,112 p=14044 u=mistral | Thursday 30 August 2018 12:19:07 -0400 (0:00:00.748) 0:05:26.891 ******* >2018-08-30 12:19:07,668 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:07,704 p=14044 u=mistral | TASK [ceph-mgr : get enabled modules from ceph-mgr] **************************** >2018-08-30 12:19:07,705 p=14044 u=mistral | Thursday 30 August 2018 12:19:07 -0400 (0:00:00.593) 0:05:27.484 ******* >2018-08-30 12:19:08,573 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:19:08,589 p=14044 u=mistral | TASK [ceph-mgr : set _ceph_mgr_modules fact] *********************************** >2018-08-30 12:19:08,589 p=14044 u=mistral | Thursday 30 August 2018 12:19:08 -0400 (0:00:00.883) 0:05:28.368 ******* >2018-08-30 12:19:08,668 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:19:08,699 p=14044 u=mistral | TASK [ceph-mgr : disable ceph mgr enabled modules] ***************************** >2018-08-30 12:19:08,699 p=14044 u=mistral | Thursday 30 August 2018 12:19:08 -0400 (0:00:00.110) 0:05:28.478 ******* >2018-08-30 12:19:08,745 p=14044 u=mistral | skipping: [172.16.0.24] => (item=status) >2018-08-30 12:19:08,775 p=14044 u=mistral | TASK [ceph-mgr : add modules to ceph-mgr] ************************************** >2018-08-30 12:19:08,776 p=14044 u=mistral | Thursday 30 August 2018 12:19:08 -0400 (0:00:00.076) 0:05:28.555 ******* >2018-08-30 12:19:08,821 p=14044 u=mistral | skipping: [172.16.0.24] => (item=status) >2018-08-30 12:19:08,838 p=14044 u=mistral | TASK [start ceph mgr] ********************************************************** >2018-08-30 12:19:08,838 p=14044 u=mistral | Thursday 30 August 2018 12:19:08 -0400 (0:00:00.062) 0:05:28.617 ******* >2018-08-30 12:19:08,868 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:19:08,883 p=14044 u=mistral | TASK [restart containerized ceph mgr] ****************************************** >2018-08-30 12:19:08,883 p=14044 u=mistral | Thursday 30 August 2018 12:19:08 -0400 (0:00:00.045) 0:05:28.662 ******* >2018-08-30 12:19:09,810 p=14044 u=mistral | changed: [172.16.0.24] >2018-08-30 12:19:09,829 p=14044 u=mistral | PLAY [upgrade ceph mgr node] *************************************************** >2018-08-30 12:19:09,957 p=14044 u=mistral | TASK [non container - get current fsid] **************************************** >2018-08-30 12:19:09,958 p=14044 u=mistral | Thursday 30 August 2018 12:19:09 -0400 (0:00:01.074) 0:05:29.737 ******* >2018-08-30 12:19:09,992 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:10,020 p=14044 u=mistral | TASK [container - get current fsid] ******************************************** >2018-08-30 12:19:10,021 p=14044 u=mistral | Thursday 30 August 2018 12:19:10 -0400 (0:00:00.062) 0:05:29.800 ******* >2018-08-30 12:19:10,916 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:19:10,929 p=14044 u=mistral | TASK [set_fact ceph_cluster_fsid] ********************************************** >2018-08-30 12:19:10,929 p=14044 u=mistral | Thursday 30 August 2018 12:19:10 -0400 (0:00:00.908) 0:05:30.708 ******* >2018-08-30 12:19:10,982 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:11,016 p=14044 u=mistral | TASK [non container | create ceph mgr keyring(s)] ****************************** >2018-08-30 12:19:11,016 p=14044 u=mistral | Thursday 30 August 2018 12:19:11 -0400 (0:00:00.087) 0:05:30.796 ******* >2018-08-30 12:19:11,054 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:19:11,062 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:19:11,067 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:19:11,100 p=14044 u=mistral | TASK [container | create ceph mgr keyring(s)] ********************************** >2018-08-30 12:19:11,100 p=14044 u=mistral | Thursday 30 August 2018 12:19:11 -0400 (0:00:00.083) 0:05:30.880 ******* >2018-08-30 12:19:11,132 p=14044 u=mistral | [WARNING]: when statements should not include jinja2 templating delimiters >such as {{ }} or {% %}. Found: {{ groups.get(mgr_group_name, []) | length > 0 >}} > >2018-08-30 12:19:11,497 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:19:12,055 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:19:12,399 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:19:12,434 p=14044 u=mistral | TASK [fetch ceph mgr key(s)] *************************************************** >2018-08-30 12:19:12,434 p=14044 u=mistral | Thursday 30 August 2018 12:19:12 -0400 (0:00:01.333) 0:05:32.214 ******* >2018-08-30 12:19:12,964 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] => (item=172.16.0.33) >2018-08-30 12:19:13,263 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] => (item=172.16.0.24) >2018-08-30 12:19:13,569 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] => (item=172.16.0.25) >2018-08-30 12:19:13,584 p=14044 u=mistral | TASK [stop ceph mgr] *********************************************************** >2018-08-30 12:19:13,584 p=14044 u=mistral | Thursday 30 August 2018 12:19:13 -0400 (0:00:01.149) 0:05:33.363 ******* >2018-08-30 12:19:13,610 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:13,628 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:19:13,628 p=14044 u=mistral | Thursday 30 August 2018 12:19:13 -0400 (0:00:00.044) 0:05:33.408 ******* >2018-08-30 12:19:14,064 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:14,087 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:19:14,088 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.459) 0:05:33.867 ******* >2018-08-30 12:19:14,120 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,135 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:19:14,136 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.047) 0:05:33.915 ******* >2018-08-30 12:19:14,174 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,189 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:19:14,190 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.053) 0:05:33.969 ******* >2018-08-30 12:19:14,225 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,240 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:19:14,240 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.050) 0:05:34.020 ******* >2018-08-30 12:19:14,606 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:14,621 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:19:14,621 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.380) 0:05:34.400 ******* >2018-08-30 12:19:14,649 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,663 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:19:14,664 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.042) 0:05:34.443 ******* >2018-08-30 12:19:14,691 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,706 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:19:14,707 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.042) 0:05:34.486 ******* >2018-08-30 12:19:14,736 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,756 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:19:14,756 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.049) 0:05:34.535 ******* >2018-08-30 12:19:14,788 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,811 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:19:14,811 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.055) 0:05:34.590 ******* >2018-08-30 12:19:14,843 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,856 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:19:14,856 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.045) 0:05:34.636 ******* >2018-08-30 12:19:14,884 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,898 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:19:14,898 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.041) 0:05:34.677 ******* >2018-08-30 12:19:14,928 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,942 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:19:14,943 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.044) 0:05:34.722 ******* >2018-08-30 12:19:14,974 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:14,988 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:19:14,988 p=14044 u=mistral | Thursday 30 August 2018 12:19:14 -0400 (0:00:00.045) 0:05:34.767 ******* >2018-08-30 12:19:15,019 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,035 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:19:15,035 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.047) 0:05:34.814 ******* >2018-08-30 12:19:15,062 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,076 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:19:15,077 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.041) 0:05:34.856 ******* >2018-08-30 12:19:15,107 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,122 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:19:15,123 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.045) 0:05:34.902 ******* >2018-08-30 12:19:15,154 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,169 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:19:15,169 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.046) 0:05:34.948 ******* >2018-08-30 12:19:15,197 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,215 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:19:15,216 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.046) 0:05:34.995 ******* >2018-08-30 12:19:15,246 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,260 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:19:15,260 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.044) 0:05:35.039 ******* >2018-08-30 12:19:15,291 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,306 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:19:15,306 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.046) 0:05:35.085 ******* >2018-08-30 12:19:15,336 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,356 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:19:15,356 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.049) 0:05:35.135 ******* >2018-08-30 12:19:15,393 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,412 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:19:15,412 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.056) 0:05:35.192 ******* >2018-08-30 12:19:15,439 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,454 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:19:15,455 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.042) 0:05:35.234 ******* >2018-08-30 12:19:15,481 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,500 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:19:15,500 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.045) 0:05:35.279 ******* >2018-08-30 12:19:15,534 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,554 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:19:15,554 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.054) 0:05:35.333 ******* >2018-08-30 12:19:15,588 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,608 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:19:15,609 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.054) 0:05:35.388 ******* >2018-08-30 12:19:15,643 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,663 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:19:15,663 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.054) 0:05:35.442 ******* >2018-08-30 12:19:15,694 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:15,718 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:19:15,718 p=14044 u=mistral | Thursday 30 August 2018 12:19:15 -0400 (0:00:00.055) 0:05:35.497 ******* >2018-08-30 12:19:16,067 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:16,082 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:19:16,082 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.364) 0:05:35.862 ******* >2018-08-30 12:19:16,142 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:16,157 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:19:16,157 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.074) 0:05:35.936 ******* >2018-08-30 12:19:16,222 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:16,238 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:19:16,239 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.081) 0:05:36.018 ******* >2018-08-30 12:19:16,264 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:16,307 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:19:16,308 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.069) 0:05:36.087 ******* >2018-08-30 12:19:16,412 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:19:16,442 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:19:16,443 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.134) 0:05:36.222 ******* >2018-08-30 12:19:16,475 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:16,500 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:19:16,501 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.057) 0:05:36.280 ******* >2018-08-30 12:19:16,744 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:19:16,758 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:19:16,758 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.257) 0:05:36.538 ******* >2018-08-30 12:19:16,829 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:16,857 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:19:16,857 p=14044 u=mistral | Thursday 30 August 2018 12:19:16 -0400 (0:00:00.098) 0:05:36.636 ******* >2018-08-30 12:19:17,122 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:19:17,136 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:19:17,136 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.279) 0:05:36.915 ******* >2018-08-30 12:19:17,163 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,178 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:19:17,178 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.041) 0:05:36.957 ******* >2018-08-30 12:19:17,239 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:17,262 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:19:17,262 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.084) 0:05:37.041 ******* >2018-08-30 12:19:17,286 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,308 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:19:17,308 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.045) 0:05:37.087 ******* >2018-08-30 12:19:17,343 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,369 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:19:17,369 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.060) 0:05:37.148 ******* >2018-08-30 12:19:17,393 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,411 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:19:17,411 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.042) 0:05:37.191 ******* >2018-08-30 12:19:17,434 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,449 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:19:17,449 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.037) 0:05:37.228 ******* >2018-08-30 12:19:17,721 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:17,736 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:19:17,736 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.286) 0:05:37.515 ******* >2018-08-30 12:19:17,763 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,779 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:19:17,780 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.043) 0:05:37.559 ******* >2018-08-30 12:19:17,807 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,821 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:19:17,821 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.041) 0:05:37.601 ******* >2018-08-30 12:19:17,849 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,865 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:19:17,865 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.043) 0:05:37.644 ******* >2018-08-30 12:19:17,894 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:17,908 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:19:17,908 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.042) 0:05:37.687 ******* >2018-08-30 12:19:17,945 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/dev/vdb) >2018-08-30 12:19:17,960 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:19:17,961 p=14044 u=mistral | Thursday 30 August 2018 12:19:17 -0400 (0:00:00.052) 0:05:37.740 ******* >2018-08-30 12:19:17,998 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:19:18,013 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:19:18,014 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.053) 0:05:37.793 ******* >2018-08-30 12:19:18,040 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:18,054 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:19:18,055 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.040) 0:05:37.834 ******* >2018-08-30 12:19:18,084 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:18,102 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:19:18,103 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.047) 0:05:37.882 ******* >2018-08-30 12:19:18,133 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:18,148 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:19:18,148 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.045) 0:05:37.927 ******* >2018-08-30 12:19:18,181 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:18,197 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:19:18,198 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.049) 0:05:37.977 ******* >2018-08-30 12:19:18,231 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:18,246 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:19:18,246 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.048) 0:05:38.025 ******* >2018-08-30 12:19:18,323 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:18,343 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:19:18,344 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.097) 0:05:38.123 ******* >2018-08-30 12:19:18,402 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:18,417 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:19:18,417 p=14044 u=mistral | Thursday 30 August 2018 12:19:18 -0400 (0:00:00.073) 0:05:38.196 ******* >2018-08-30 12:19:18,811 p=14044 u=mistral | ok: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:19:19,339 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/) >2018-08-30 12:19:19,640 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mon) >2018-08-30 12:19:19,954 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/osd) >2018-08-30 12:19:20,272 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mds) >2018-08-30 12:19:20,563 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/tmp) >2018-08-30 12:19:20,858 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:19:21,146 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:19:21,455 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:19:21,743 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:19:22,034 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:19:22,319 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:19:22,339 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:19:22,339 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:03.921) 0:05:42.118 ******* >2018-08-30 12:19:22,367 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,381 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:19:22,382 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.042) 0:05:42.161 ******* >2018-08-30 12:19:22,410 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,425 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:19:22,426 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.043) 0:05:42.205 ******* >2018-08-30 12:19:22,460 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,477 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:19:22,477 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.051) 0:05:42.257 ******* >2018-08-30 12:19:22,513 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,531 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:19:22,532 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.054) 0:05:42.311 ******* >2018-08-30 12:19:22,561 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,577 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:19:22,578 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.045) 0:05:42.357 ******* >2018-08-30 12:19:22,605 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,621 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:19:22,621 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.043) 0:05:42.400 ******* >2018-08-30 12:19:22,649 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,663 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:19:22,664 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.042) 0:05:42.443 ******* >2018-08-30 12:19:22,693 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,707 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:19:22,707 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.043) 0:05:42.487 ******* >2018-08-30 12:19:22,735 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,749 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:19:22,749 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.041) 0:05:42.529 ******* >2018-08-30 12:19:22,778 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,801 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:19:22,801 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.051) 0:05:42.580 ******* >2018-08-30 12:19:22,829 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,844 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:19:22,845 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.043) 0:05:42.624 ******* >2018-08-30 12:19:22,872 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,886 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:19:22,886 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.041) 0:05:42.665 ******* >2018-08-30 12:19:22,916 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,928 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:19:22,928 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.042) 0:05:42.707 ******* >2018-08-30 12:19:22,958 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:22,972 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:19:22,972 p=14044 u=mistral | Thursday 30 August 2018 12:19:22 -0400 (0:00:00.043) 0:05:42.751 ******* >2018-08-30 12:19:23,000 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,016 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:19:23,017 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.044) 0:05:42.796 ******* >2018-08-30 12:19:23,047 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,062 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:19:23,062 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.045) 0:05:42.841 ******* >2018-08-30 12:19:23,092 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,106 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:19:23,107 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.044) 0:05:42.886 ******* >2018-08-30 12:19:23,135 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,150 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:19:23,150 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.043) 0:05:42.930 ******* >2018-08-30 12:19:23,185 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,199 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:19:23,199 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.048) 0:05:42.978 ******* >2018-08-30 12:19:23,225 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,243 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:19:23,243 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.043) 0:05:43.022 ******* >2018-08-30 12:19:23,278 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,292 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:19:23,293 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.049) 0:05:43.072 ******* >2018-08-30 12:19:23,321 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,335 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:19:23,335 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.042) 0:05:43.114 ******* >2018-08-30 12:19:23,365 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,380 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:19:23,380 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.044) 0:05:43.159 ******* >2018-08-30 12:19:23,407 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,421 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:19:23,422 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.041) 0:05:43.201 ******* >2018-08-30 12:19:23,452 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,467 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:19:23,467 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.044) 0:05:43.246 ******* >2018-08-30 12:19:23,496 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,510 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:19:23,510 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.043) 0:05:43.289 ******* >2018-08-30 12:19:23,540 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,558 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-controller02/keyring already exists] *** >2018-08-30 12:19:23,558 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.048) 0:05:43.338 ******* >2018-08-30 12:19:23,590 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,606 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-controller02/keyring doesn't exist] *** >2018-08-30 12:19:23,606 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.047) 0:05:43.385 ******* >2018-08-30 12:19:23,630 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,645 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:19:23,646 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.039) 0:05:43.425 ******* >2018-08-30 12:19:23,676 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,691 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:19:23,691 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.045) 0:05:43.471 ******* >2018-08-30 12:19:23,719 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,733 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:19:23,733 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.041) 0:05:43.512 ******* >2018-08-30 12:19:23,765 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,787 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:19:23,787 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.053) 0:05:43.566 ******* >2018-08-30 12:19:23,816 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,831 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:19:23,832 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.044) 0:05:43.611 ******* >2018-08-30 12:19:23,864 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,879 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:19:23,880 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.047) 0:05:43.659 ******* >2018-08-30 12:19:23,918 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:19:23,926 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/log/ceph) >2018-08-30 12:19:23,940 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:19:23,940 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.060) 0:05:43.719 ******* >2018-08-30 12:19:23,967 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:23,981 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:19:23,981 p=14044 u=mistral | Thursday 30 August 2018 12:19:23 -0400 (0:00:00.041) 0:05:43.760 ******* >2018-08-30 12:19:24,011 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,026 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:19:24,026 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.044) 0:05:43.805 ******* >2018-08-30 12:19:24,056 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,070 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:19:24,071 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.044) 0:05:43.850 ******* >2018-08-30 12:19:24,102 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,118 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:19:24,118 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.047) 0:05:43.897 ******* >2018-08-30 12:19:24,146 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,163 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:19:24,163 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.045) 0:05:43.942 ******* >2018-08-30 12:19:24,197 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,214 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:19:24,215 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.051) 0:05:43.994 ******* >2018-08-30 12:19:24,254 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,267 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:19:24,267 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.052) 0:05:44.046 ******* >2018-08-30 12:19:24,323 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,338 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:19:24,339 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.071) 0:05:44.118 ******* >2018-08-30 12:19:24,369 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:24,385 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:19:24,385 p=14044 u=mistral | Thursday 30 August 2018 12:19:24 -0400 (0:00:00.046) 0:05:44.164 ******* >2018-08-30 12:19:24,771 p=14044 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:19:25,264 p=14044 u=mistral | ok: [172.16.0.25] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:19:25,289 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:19:25,289 p=14044 u=mistral | Thursday 30 August 2018 12:19:25 -0400 (0:00:00.904) 0:05:45.068 ******* >2018-08-30 12:19:25,565 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:25,580 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:19:25,581 p=14044 u=mistral | Thursday 30 August 2018 12:19:25 -0400 (0:00:00.291) 0:05:45.360 ******* >2018-08-30 12:19:25,603 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:25,619 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:19:25,619 p=14044 u=mistral | Thursday 30 August 2018 12:19:25 -0400 (0:00:00.038) 0:05:45.398 ******* >2018-08-30 12:19:25,979 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:26,003 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:19:26,003 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.383) 0:05:45.782 ******* >2018-08-30 12:19:26,070 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:26,086 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:19:26,086 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.082) 0:05:45.865 ******* >2018-08-30 12:19:26,453 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:26,467 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:19:26,467 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.380) 0:05:46.246 ******* >2018-08-30 12:19:26,504 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:26,520 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:19:26,521 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.053) 0:05:46.300 ******* >2018-08-30 12:19:26,580 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.33) >2018-08-30 12:19:26,603 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.24) >2018-08-30 12:19:26,631 p=14044 u=mistral | skipping: [172.16.0.25] => (item=172.16.0.25) >2018-08-30 12:19:26,649 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:19:26,649 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.128) 0:05:46.428 ******* >2018-08-30 12:19:26,690 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:26,708 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:19:26,709 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.059) 0:05:46.488 ******* >2018-08-30 12:19:26,752 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:26,784 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:19:26,784 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.075) 0:05:46.563 ******* >2018-08-30 12:19:26,832 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/etc/ceph/ceph.client.admin.keyring) >2018-08-30 12:19:26,847 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/etc/ceph/ceph.mon.keyring) >2018-08-30 12:19:26,864 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd/ceph.keyring) >2018-08-30 12:19:26,884 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw/ceph.keyring) >2018-08-30 12:19:26,903 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds/ceph.keyring) >2018-08-30 12:19:26,923 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd/ceph.keyring) >2018-08-30 12:19:26,939 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:19:26,939 p=14044 u=mistral | Thursday 30 August 2018 12:19:26 -0400 (0:00:00.155) 0:05:46.719 ******* >2018-08-30 12:19:26,993 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.client.admin.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.client.admin.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:19:27,007 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/etc/ceph/ceph.mon.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/etc/ceph/ceph.mon.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:19:27,023 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-osd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:19:27,038 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rgw/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:19:27,054 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-mds/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-mds/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:19:27,072 p=14044 u=mistral | skipping: [172.16.0.25] => (item=[u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/var/lib/ceph/bootstrap-rbd/ceph.keyring', 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:19:27,087 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:19:27,088 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.148) 0:05:46.867 ******* >2018-08-30 12:19:27,114 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,128 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:19:27,128 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.040) 0:05:46.908 ******* >2018-08-30 12:19:27,154 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,171 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:19:27,171 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.042) 0:05:46.950 ******* >2018-08-30 12:19:27,206 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,221 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:19:27,221 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.049) 0:05:47.000 ******* >2018-08-30 12:19:27,255 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,271 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:19:27,272 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.050) 0:05:47.051 ******* >2018-08-30 12:19:27,307 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,322 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:19:27,323 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.050) 0:05:47.102 ******* >2018-08-30 12:19:27,354 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,371 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:19:27,371 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.048) 0:05:47.150 ******* >2018-08-30 12:19:27,400 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,416 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:19:27,416 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.044) 0:05:47.195 ******* >2018-08-30 12:19:27,446 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:27,460 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:19:27,461 p=14044 u=mistral | Thursday 30 August 2018 12:19:27 -0400 (0:00:00.044) 0:05:47.240 ******* >2018-08-30 12:19:28,066 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:28,090 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:19:28,090 p=14044 u=mistral | Thursday 30 August 2018 12:19:28 -0400 (0:00:00.629) 0:05:47.869 ******* >2018-08-30 12:19:28,121 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:28,137 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:19:28,137 p=14044 u=mistral | Thursday 30 August 2018 12:19:28 -0400 (0:00:00.047) 0:05:47.916 ******* >2018-08-30 12:19:28,172 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:28,188 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:19:28,189 p=14044 u=mistral | Thursday 30 August 2018 12:19:28 -0400 (0:00:00.051) 0:05:47.968 ******* >2018-08-30 12:19:28,229 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:28,245 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:19:28,245 p=14044 u=mistral | Thursday 30 August 2018 12:19:28 -0400 (0:00:00.056) 0:05:48.024 ******* >2018-08-30 12:19:28,630 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:28,653 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:19:28,653 p=14044 u=mistral | Thursday 30 August 2018 12:19:28 -0400 (0:00:00.408) 0:05:48.433 ******* >2018-08-30 12:19:28,684 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:28,705 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:19:28,705 p=14044 u=mistral | Thursday 30 August 2018 12:19:28 -0400 (0:00:00.051) 0:05:48.484 ******* >2018-08-30 12:19:28,736 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:28,751 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:19:28,752 p=14044 u=mistral | Thursday 30 August 2018 12:19:28 -0400 (0:00:00.046) 0:05:48.531 ******* >2018-08-30 12:19:29,180 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:29,205 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:19:29,205 p=14044 u=mistral | Thursday 30 August 2018 12:19:29 -0400 (0:00:00.453) 0:05:48.984 ******* >2018-08-30 12:19:29,240 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:29,256 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:19:29,256 p=14044 u=mistral | Thursday 30 August 2018 12:19:29 -0400 (0:00:00.050) 0:05:49.035 ******* >2018-08-30 12:19:29,292 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:29,311 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:19:29,312 p=14044 u=mistral | Thursday 30 August 2018 12:19:29 -0400 (0:00:00.055) 0:05:49.091 ******* >2018-08-30 12:19:29,346 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:29,364 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:19:29,365 p=14044 u=mistral | Thursday 30 August 2018 12:19:29 -0400 (0:00:00.052) 0:05:49.144 ******* >2018-08-30 12:19:30,030 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:30,055 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:19:30,055 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.690) 0:05:49.834 ******* >2018-08-30 12:19:30,085 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:30,102 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:19:30,102 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.047) 0:05:49.882 ******* >2018-08-30 12:19:30,133 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:30,147 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:19:30,148 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.045) 0:05:49.927 ******* >2018-08-30 12:19:30,218 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:30,233 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:19:30,233 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.085) 0:05:50.013 ******* >2018-08-30 12:19:30,266 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:30,282 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:19:30,282 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.048) 0:05:50.061 ******* >2018-08-30 12:19:30,311 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:30,325 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:19:30,326 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.043) 0:05:50.105 ******* >2018-08-30 12:19:30,355 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:30,370 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:19:30,370 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.044) 0:05:50.149 ******* >2018-08-30 12:19:30,440 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:30,457 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:19:30,458 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.087) 0:05:50.237 ******* >2018-08-30 12:19:30,486 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:30,503 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:19:30,504 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.045) 0:05:50.283 ******* >2018-08-30 12:19:30,539 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:30,557 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:19:30,557 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.053) 0:05:50.336 ******* >2018-08-30 12:19:30,962 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:30,977 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:19:30,978 p=14044 u=mistral | Thursday 30 August 2018 12:19:30 -0400 (0:00:00.420) 0:05:50.757 ******* >2018-08-30 12:19:31,600 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:19:31,620 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:19:31,621 p=14044 u=mistral | Thursday 30 August 2018 12:19:31 -0400 (0:00:00.642) 0:05:51.400 ******* >2018-08-30 12:19:31,876 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:31,892 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:19:31,892 p=14044 u=mistral | Thursday 30 August 2018 12:19:31 -0400 (0:00:00.271) 0:05:51.671 ******* >2018-08-30 12:19:31,929 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:31,945 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:19:31,945 p=14044 u=mistral | Thursday 30 August 2018 12:19:31 -0400 (0:00:00.053) 0:05:51.724 ******* >2018-08-30 12:19:31,976 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:31,996 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:19:31,996 p=14044 u=mistral | Thursday 30 August 2018 12:19:31 -0400 (0:00:00.050) 0:05:51.775 ******* >2018-08-30 12:19:32,026 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,044 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:19:32,044 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.048) 0:05:51.823 ******* >2018-08-30 12:19:32,077 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,093 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:19:32,093 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.048) 0:05:51.872 ******* >2018-08-30 12:19:32,135 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,150 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:19:32,150 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.057) 0:05:51.930 ******* >2018-08-30 12:19:32,182 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,198 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:19:32,198 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.047) 0:05:51.977 ******* >2018-08-30 12:19:32,225 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,248 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:19:32,248 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.050) 0:05:52.027 ******* >2018-08-30 12:19:32,278 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,292 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:19:32,292 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.043) 0:05:52.071 ******* >2018-08-30 12:19:32,322 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,338 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:19:32,338 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.046) 0:05:52.117 ******* >2018-08-30 12:19:32,370 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,386 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:19:32,386 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.047) 0:05:52.165 ******* >2018-08-30 12:19:32,413 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:32,428 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:19:32,429 p=14044 u=mistral | Thursday 30 August 2018 12:19:32 -0400 (0:00:00.042) 0:05:52.208 ******* >2018-08-30 12:19:33,412 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:33,427 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:19:33,428 p=14044 u=mistral | Thursday 30 August 2018 12:19:33 -0400 (0:00:00.998) 0:05:53.207 ******* >2018-08-30 12:19:33,494 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:33,510 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:19:33,510 p=14044 u=mistral | Thursday 30 August 2018 12:19:33 -0400 (0:00:00.082) 0:05:53.289 ******* >2018-08-30 12:19:33,550 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:33,565 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:19:33,566 p=14044 u=mistral | Thursday 30 August 2018 12:19:33 -0400 (0:00:00.055) 0:05:53.345 ******* >2018-08-30 12:19:33,593 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:33,608 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:19:33,608 p=14044 u=mistral | Thursday 30 August 2018 12:19:33 -0400 (0:00:00.042) 0:05:53.388 ******* >2018-08-30 12:19:33,861 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:33,881 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:19:33,881 p=14044 u=mistral | Thursday 30 August 2018 12:19:33 -0400 (0:00:00.272) 0:05:53.660 ******* >2018-08-30 12:19:33,913 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:33,932 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:19:33,933 p=14044 u=mistral | Thursday 30 August 2018 12:19:33 -0400 (0:00:00.051) 0:05:53.712 ******* >2018-08-30 12:19:33,965 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:33,979 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:19:33,979 p=14044 u=mistral | Thursday 30 August 2018 12:19:33 -0400 (0:00:00.046) 0:05:53.759 ******* >2018-08-30 12:19:34,563 p=14044 u=mistral | changed: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:19:34,853 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:19:35,155 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:19:35,508 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:19:35,833 p=14044 u=mistral | changed: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:19:35,852 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:19:35,853 p=14044 u=mistral | Thursday 30 August 2018 12:19:35 -0400 (0:00:01.873) 0:05:55.632 ******* >2018-08-30 12:19:35,882 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:35,901 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:19:35,901 p=14044 u=mistral | Thursday 30 August 2018 12:19:35 -0400 (0:00:00.048) 0:05:55.680 ******* >2018-08-30 12:19:35,932 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:35,956 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:19:35,956 p=14044 u=mistral | Thursday 30 August 2018 12:19:35 -0400 (0:00:00.054) 0:05:55.735 ******* >2018-08-30 12:19:36,222 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:19:36,252 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:19:36,252 p=14044 u=mistral | Thursday 30 August 2018 12:19:36 -0400 (0:00:00.296) 0:05:56.032 ******* >2018-08-30 12:19:36,283 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:36,304 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:19:36,304 p=14044 u=mistral | Thursday 30 August 2018 12:19:36 -0400 (0:00:00.051) 0:05:56.083 ******* >2018-08-30 12:19:36,340 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:36,355 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:19:36,356 p=14044 u=mistral | Thursday 30 August 2018 12:19:36 -0400 (0:00:00.051) 0:05:56.135 ******* >2018-08-30 12:19:36,904 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:19:36,920 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:19:36,921 p=14044 u=mistral | Thursday 30 August 2018 12:19:36 -0400 (0:00:00.565) 0:05:56.700 ******* >2018-08-30 12:19:37,975 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:37,991 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:19:37,991 p=14044 u=mistral | Thursday 30 August 2018 12:19:37 -0400 (0:00:01.070) 0:05:57.770 ******* >2018-08-30 12:19:38,022 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:38,035 p=14044 u=mistral | TASK [ceph-mgr : set_fact docker_exec_cmd] ************************************* >2018-08-30 12:19:38,036 p=14044 u=mistral | Thursday 30 August 2018 12:19:38 -0400 (0:00:00.044) 0:05:57.815 ******* >2018-08-30 12:19:38,118 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:38,134 p=14044 u=mistral | TASK [ceph-mgr : create mgr directory] ***************************************** >2018-08-30 12:19:38,134 p=14044 u=mistral | Thursday 30 August 2018 12:19:38 -0400 (0:00:00.098) 0:05:57.913 ******* >2018-08-30 12:19:38,460 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:38,473 p=14044 u=mistral | TASK [ceph-mgr : copy ceph keyring(s) if needed] ******************************* >2018-08-30 12:19:38,473 p=14044 u=mistral | Thursday 30 August 2018 12:19:38 -0400 (0:00:00.339) 0:05:58.253 ******* >2018-08-30 12:19:39,417 p=14044 u=mistral | ok: [172.16.0.25] => (item={u'dest': u'/var/lib/ceph/mgr/ceph-lab-controller02/keyring', u'name': u'/etc/ceph/ceph.mgr.lab-controller02.keyring', u'copy_key': True}) >2018-08-30 12:19:39,432 p=14044 u=mistral | skipping: [172.16.0.25] => (item={u'dest': u'/etc/ceph/ceph.client.admin.keyring', u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:19:39,449 p=14044 u=mistral | TASK [ceph-mgr : set mgr key permissions] ************************************** >2018-08-30 12:19:39,449 p=14044 u=mistral | Thursday 30 August 2018 12:19:39 -0400 (0:00:00.975) 0:05:59.228 ******* >2018-08-30 12:19:39,961 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:39,977 p=14044 u=mistral | TASK [ceph-mgr : install ceph-mgr package on RedHat or SUSE] ******************* >2018-08-30 12:19:39,977 p=14044 u=mistral | Thursday 30 August 2018 12:19:39 -0400 (0:00:00.527) 0:05:59.756 ******* >2018-08-30 12:19:40,010 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:40,026 p=14044 u=mistral | TASK [ceph-mgr : install ceph mgr for debian] ********************************** >2018-08-30 12:19:40,026 p=14044 u=mistral | Thursday 30 August 2018 12:19:40 -0400 (0:00:00.048) 0:05:59.805 ******* >2018-08-30 12:19:40,062 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:40,076 p=14044 u=mistral | TASK [ceph-mgr : ensure systemd service override directory exists] ************* >2018-08-30 12:19:40,076 p=14044 u=mistral | Thursday 30 August 2018 12:19:40 -0400 (0:00:00.049) 0:05:59.855 ******* >2018-08-30 12:19:40,115 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:40,129 p=14044 u=mistral | TASK [ceph-mgr : add ceph-mgr systemd service overrides] *********************** >2018-08-30 12:19:40,129 p=14044 u=mistral | Thursday 30 August 2018 12:19:40 -0400 (0:00:00.053) 0:05:59.908 ******* >2018-08-30 12:19:40,167 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:40,180 p=14044 u=mistral | TASK [ceph-mgr : start and add that the mgr service to the init sequence] ****** >2018-08-30 12:19:40,180 p=14044 u=mistral | Thursday 30 August 2018 12:19:40 -0400 (0:00:00.050) 0:05:59.959 ******* >2018-08-30 12:19:40,214 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:40,235 p=14044 u=mistral | TASK [ceph-mgr : generate systemd unit file] *********************************** >2018-08-30 12:19:40,236 p=14044 u=mistral | Thursday 30 August 2018 12:19:40 -0400 (0:00:00.055) 0:06:00.015 ******* >2018-08-30 12:19:41,009 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:41,024 p=14044 u=mistral | TASK [ceph-mgr : systemd start mgr container] ********************************** >2018-08-30 12:19:41,024 p=14044 u=mistral | Thursday 30 August 2018 12:19:41 -0400 (0:00:00.788) 0:06:00.804 ******* >2018-08-30 12:19:41,801 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:41,828 p=14044 u=mistral | TASK [ceph-mgr : get enabled modules from ceph-mgr] **************************** >2018-08-30 12:19:41,828 p=14044 u=mistral | Thursday 30 August 2018 12:19:41 -0400 (0:00:00.803) 0:06:01.607 ******* >2018-08-30 12:19:42,899 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:19:42,913 p=14044 u=mistral | TASK [ceph-mgr : set _ceph_mgr_modules fact] *********************************** >2018-08-30 12:19:42,913 p=14044 u=mistral | Thursday 30 August 2018 12:19:42 -0400 (0:00:01.085) 0:06:02.692 ******* >2018-08-30 12:19:42,975 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:19:43,006 p=14044 u=mistral | TASK [ceph-mgr : disable ceph mgr enabled modules] ***************************** >2018-08-30 12:19:43,007 p=14044 u=mistral | Thursday 30 August 2018 12:19:43 -0400 (0:00:00.093) 0:06:02.786 ******* >2018-08-30 12:19:43,059 p=14044 u=mistral | skipping: [172.16.0.25] => (item=status) >2018-08-30 12:19:43,091 p=14044 u=mistral | TASK [ceph-mgr : add modules to ceph-mgr] ************************************** >2018-08-30 12:19:43,092 p=14044 u=mistral | Thursday 30 August 2018 12:19:43 -0400 (0:00:00.085) 0:06:02.871 ******* >2018-08-30 12:19:43,133 p=14044 u=mistral | skipping: [172.16.0.25] => (item=status) >2018-08-30 12:19:43,148 p=14044 u=mistral | TASK [start ceph mgr] ********************************************************** >2018-08-30 12:19:43,149 p=14044 u=mistral | Thursday 30 August 2018 12:19:43 -0400 (0:00:00.056) 0:06:02.928 ******* >2018-08-30 12:19:43,180 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:19:43,195 p=14044 u=mistral | TASK [restart containerized ceph mgr] ****************************************** >2018-08-30 12:19:43,195 p=14044 u=mistral | Thursday 30 August 2018 12:19:43 -0400 (0:00:00.046) 0:06:02.974 ******* >2018-08-30 12:19:44,543 p=14044 u=mistral | changed: [172.16.0.25] >2018-08-30 12:19:44,564 p=14044 u=mistral | PLAY [upgrade ceph osds cluster] *********************************************** >2018-08-30 12:19:44,832 p=14044 u=mistral | TASK [get osd numbers] ********************************************************* >2018-08-30 12:19:44,832 p=14044 u=mistral | Thursday 30 August 2018 12:19:44 -0400 (0:00:01.636) 0:06:04.611 ******* >2018-08-30 12:19:44,860 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:44,873 p=14044 u=mistral | TASK [stop ceph osd] *********************************************************** >2018-08-30 12:19:44,873 p=14044 u=mistral | Thursday 30 August 2018 12:19:44 -0400 (0:00:00.041) 0:06:04.652 ******* >2018-08-30 12:19:44,902 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:44,917 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:19:44,917 p=14044 u=mistral | Thursday 30 August 2018 12:19:44 -0400 (0:00:00.044) 0:06:04.696 ******* >2018-08-30 12:19:44,948 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:44,964 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:19:44,964 p=14044 u=mistral | Thursday 30 August 2018 12:19:44 -0400 (0:00:00.047) 0:06:04.744 ******* >2018-08-30 12:19:45,348 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:45,361 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:19:45,361 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.396) 0:06:05.140 ******* >2018-08-30 12:19:45,390 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,402 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:19:45,402 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.041) 0:06:05.182 ******* >2018-08-30 12:19:45,430 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,444 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:19:45,444 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.041) 0:06:05.223 ******* >2018-08-30 12:19:45,472 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,486 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:19:45,486 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.041) 0:06:05.265 ******* >2018-08-30 12:19:45,516 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,529 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:19:45,529 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.042) 0:06:05.308 ******* >2018-08-30 12:19:45,562 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,575 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:19:45,575 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.046) 0:06:05.355 ******* >2018-08-30 12:19:45,605 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,619 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:19:45,620 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.044) 0:06:05.399 ******* >2018-08-30 12:19:45,646 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,659 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:19:45,659 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.039) 0:06:05.439 ******* >2018-08-30 12:19:45,688 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,703 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:19:45,703 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.043) 0:06:05.482 ******* >2018-08-30 12:19:45,738 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,753 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:19:45,753 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.050) 0:06:05.533 ******* >2018-08-30 12:19:45,785 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,798 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:19:45,798 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.044) 0:06:05.578 ******* >2018-08-30 12:19:45,826 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,841 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:19:45,841 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.042) 0:06:05.620 ******* >2018-08-30 12:19:45,876 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,891 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:19:45,891 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.049) 0:06:05.670 ******* >2018-08-30 12:19:45,925 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,939 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:19:45,939 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.047) 0:06:05.718 ******* >2018-08-30 12:19:45,976 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:45,989 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:19:45,989 p=14044 u=mistral | Thursday 30 August 2018 12:19:45 -0400 (0:00:00.050) 0:06:05.768 ******* >2018-08-30 12:19:46,015 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,031 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:19:46,031 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.041) 0:06:05.810 ******* >2018-08-30 12:19:46,064 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,077 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:19:46,077 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.046) 0:06:05.856 ******* >2018-08-30 12:19:46,106 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,119 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:19:46,120 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.042) 0:06:05.899 ******* >2018-08-30 12:19:46,149 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,163 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:19:46,163 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.043) 0:06:05.942 ******* >2018-08-30 12:19:46,189 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,202 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:19:46,203 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.039) 0:06:05.982 ******* >2018-08-30 12:19:46,230 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,244 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:19:46,244 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.041) 0:06:06.023 ******* >2018-08-30 12:19:46,271 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,285 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:19:46,286 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.041) 0:06:06.065 ******* >2018-08-30 12:19:46,312 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,326 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:19:46,327 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.040) 0:06:06.106 ******* >2018-08-30 12:19:46,356 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,371 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:19:46,371 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.044) 0:06:06.150 ******* >2018-08-30 12:19:46,401 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,413 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:19:46,414 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.042) 0:06:06.193 ******* >2018-08-30 12:19:46,444 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,457 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:19:46,457 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.043) 0:06:06.237 ******* >2018-08-30 12:19:46,489 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:46,502 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:19:46,502 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.044) 0:06:06.281 ******* >2018-08-30 12:19:46,810 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:46,823 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:19:46,823 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.321) 0:06:06.603 ******* >2018-08-30 12:19:46,883 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:46,896 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:19:46,896 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.072) 0:06:06.675 ******* >2018-08-30 12:19:46,953 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:46,966 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:19:46,966 p=14044 u=mistral | Thursday 30 August 2018 12:19:46 -0400 (0:00:00.070) 0:06:06.746 ******* >2018-08-30 12:19:46,994 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:47,023 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:19:47,023 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.056) 0:06:06.803 ******* >2018-08-30 12:19:47,128 p=14044 u=mistral | ok: [172.16.0.28 -> 172.16.0.33] >2018-08-30 12:19:47,160 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:19:47,161 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.137) 0:06:06.940 ******* >2018-08-30 12:19:47,193 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:47,217 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:19:47,217 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.056) 0:06:06.996 ******* >2018-08-30 12:19:47,441 p=14044 u=mistral | ok: [172.16.0.28 -> localhost] >2018-08-30 12:19:47,454 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:19:47,454 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.236) 0:06:07.233 ******* >2018-08-30 12:19:47,523 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:47,542 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:19:47,542 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.087) 0:06:07.321 ******* >2018-08-30 12:19:47,773 p=14044 u=mistral | ok: [172.16.0.28 -> localhost] >2018-08-30 12:19:47,786 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:19:47,786 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.243) 0:06:07.565 ******* >2018-08-30 12:19:47,815 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:47,828 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:19:47,828 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.042) 0:06:07.608 ******* >2018-08-30 12:19:47,888 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:47,910 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:19:47,911 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.082) 0:06:07.690 ******* >2018-08-30 12:19:47,936 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:47,964 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:19:47,964 p=14044 u=mistral | Thursday 30 August 2018 12:19:47 -0400 (0:00:00.053) 0:06:07.744 ******* >2018-08-30 12:19:47,993 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:48,013 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:19:48,013 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.048) 0:06:07.793 ******* >2018-08-30 12:19:48,039 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:48,053 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:19:48,053 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.039) 0:06:07.833 ******* >2018-08-30 12:19:48,079 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:48,094 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:19:48,095 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.041) 0:06:07.874 ******* >2018-08-30 12:19:48,169 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:48,182 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:19:48,182 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.087) 0:06:07.962 ******* >2018-08-30 12:19:48,209 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:48,222 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:19:48,222 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.039) 0:06:08.001 ******* >2018-08-30 12:19:48,288 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:48,301 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:19:48,301 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.079) 0:06:08.080 ******* >2018-08-30 12:19:48,368 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:48,382 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:19:48,383 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.081) 0:06:08.162 ******* >2018-08-30 12:19:48,455 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:48,471 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:19:48,471 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.088) 0:06:08.250 ******* >2018-08-30 12:19:48,820 p=14044 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:19:48,837 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:19:48,837 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.366) 0:06:08.617 ******* >2018-08-30 12:19:48,931 p=14044 u=mistral | ok: [172.16.0.28] => (item={'_ansible_parsed': True, 'stderr_lines': [], '_ansible_item_result': True, u'end': u'2018-08-30 12:19:49.770642', '_ansible_no_log': False, u'stdout': u'/dev/vdb', u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'rc': 0, 'item': u'/dev/vdb', u'delta': u'0:00:00.005893', u'stderr': u'', u'changed': False, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:19:49.764749', '_ansible_ignore_errors': None, 'failed': False}) >2018-08-30 12:19:48,947 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:19:48,948 p=14044 u=mistral | Thursday 30 August 2018 12:19:48 -0400 (0:00:00.110) 0:06:08.727 ******* >2018-08-30 12:19:49,030 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:49,043 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:19:49,043 p=14044 u=mistral | Thursday 30 August 2018 12:19:49 -0400 (0:00:00.095) 0:06:08.822 ******* >2018-08-30 12:19:49,070 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:49,086 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:19:49,086 p=14044 u=mistral | Thursday 30 August 2018 12:19:49 -0400 (0:00:00.042) 0:06:08.865 ******* >2018-08-30 12:19:49,115 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:49,130 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:19:49,130 p=14044 u=mistral | Thursday 30 August 2018 12:19:49 -0400 (0:00:00.043) 0:06:08.909 ******* >2018-08-30 12:19:49,161 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:49,174 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:19:49,175 p=14044 u=mistral | Thursday 30 August 2018 12:19:49 -0400 (0:00:00.044) 0:06:08.954 ******* >2018-08-30 12:19:49,212 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:49,224 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:19:49,224 p=14044 u=mistral | Thursday 30 August 2018 12:19:49 -0400 (0:00:00.049) 0:06:09.004 ******* >2018-08-30 12:19:49,301 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:49,314 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:19:49,315 p=14044 u=mistral | Thursday 30 August 2018 12:19:49 -0400 (0:00:00.090) 0:06:09.094 ******* >2018-08-30 12:19:49,370 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:49,384 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:19:49,385 p=14044 u=mistral | Thursday 30 August 2018 12:19:49 -0400 (0:00:00.069) 0:06:09.164 ******* >2018-08-30 12:19:49,696 p=14044 u=mistral | changed: [172.16.0.28] => (item=/etc/ceph) >2018-08-30 12:19:49,963 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/) >2018-08-30 12:19:50,245 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/mon) >2018-08-30 12:19:50,541 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/osd) >2018-08-30 12:19:50,836 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/mds) >2018-08-30 12:19:51,130 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/tmp) >2018-08-30 12:19:51,451 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:19:51,747 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:19:52,158 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:19:52,429 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:19:52,727 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:19:53,006 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/run/ceph) >2018-08-30 12:19:53,032 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:19:53,032 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:03.647) 0:06:12.811 ******* >2018-08-30 12:19:53,063 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,076 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:19:53,077 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.044) 0:06:12.856 ******* >2018-08-30 12:19:53,105 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,120 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:19:53,120 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.043) 0:06:12.899 ******* >2018-08-30 12:19:53,152 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,165 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:19:53,165 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.045) 0:06:12.944 ******* >2018-08-30 12:19:53,199 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,216 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:19:53,216 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.051) 0:06:12.996 ******* >2018-08-30 12:19:53,244 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,264 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:19:53,265 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.048) 0:06:13.044 ******* >2018-08-30 12:19:53,300 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,318 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:19:53,318 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.053) 0:06:13.097 ******* >2018-08-30 12:19:53,349 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,362 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:19:53,362 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.044) 0:06:13.142 ******* >2018-08-30 12:19:53,392 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,415 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:19:53,415 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.052) 0:06:13.194 ******* >2018-08-30 12:19:53,452 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,466 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:19:53,466 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.051) 0:06:13.246 ******* >2018-08-30 12:19:53,498 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,515 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:19:53,515 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.048) 0:06:13.294 ******* >2018-08-30 12:19:53,549 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,562 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:19:53,563 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.047) 0:06:13.342 ******* >2018-08-30 12:19:53,596 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,609 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:19:53,610 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.046) 0:06:13.389 ******* >2018-08-30 12:19:53,645 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,660 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:19:53,660 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.050) 0:06:13.439 ******* >2018-08-30 12:19:53,689 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,702 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:19:53,703 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.042) 0:06:13.482 ******* >2018-08-30 12:19:53,733 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,746 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:19:53,746 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.043) 0:06:13.526 ******* >2018-08-30 12:19:53,779 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,792 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:19:53,792 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.045) 0:06:13.572 ******* >2018-08-30 12:19:53,821 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,835 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:19:53,835 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.042) 0:06:13.614 ******* >2018-08-30 12:19:53,866 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,879 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:19:53,879 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.043) 0:06:13.658 ******* >2018-08-30 12:19:53,908 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,928 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:19:53,928 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.049) 0:06:13.707 ******* >2018-08-30 12:19:53,962 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:53,978 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:19:53,979 p=14044 u=mistral | Thursday 30 August 2018 12:19:53 -0400 (0:00:00.050) 0:06:13.758 ******* >2018-08-30 12:19:54,011 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,027 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:19:54,027 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.048) 0:06:13.806 ******* >2018-08-30 12:19:54,057 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,072 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:19:54,072 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.045) 0:06:13.851 ******* >2018-08-30 12:19:54,104 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,117 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:19:54,117 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.044) 0:06:13.896 ******* >2018-08-30 12:19:54,145 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,158 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:19:54,159 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.041) 0:06:13.938 ******* >2018-08-30 12:19:54,187 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,199 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:19:54,199 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.040) 0:06:13.978 ******* >2018-08-30 12:19:54,229 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,250 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:19:54,251 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.051) 0:06:14.030 ******* >2018-08-30 12:19:54,281 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,305 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-ceph02/keyring already exists] *** >2018-08-30 12:19:54,305 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.054) 0:06:14.084 ******* >2018-08-30 12:19:54,337 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,354 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-ceph02/keyring doesn't exist] *** >2018-08-30 12:19:54,354 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.049) 0:06:14.133 ******* >2018-08-30 12:19:54,384 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,399 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:19:54,399 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.044) 0:06:14.178 ******* >2018-08-30 12:19:54,429 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,441 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:19:54,441 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.042) 0:06:14.221 ******* >2018-08-30 12:19:54,468 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,486 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:19:54,486 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.044) 0:06:14.266 ******* >2018-08-30 12:19:54,516 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,537 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:19:54,537 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.050) 0:06:14.316 ******* >2018-08-30 12:19:54,566 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,579 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:19:54,579 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.041) 0:06:14.358 ******* >2018-08-30 12:19:54,609 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,621 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:19:54,622 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.042) 0:06:14.401 ******* >2018-08-30 12:19:54,660 p=14044 u=mistral | skipping: [172.16.0.28] => (item=/var/run/ceph) >2018-08-30 12:19:54,665 p=14044 u=mistral | skipping: [172.16.0.28] => (item=/var/log/ceph) >2018-08-30 12:19:54,678 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:19:54,678 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.056) 0:06:14.457 ******* >2018-08-30 12:19:54,706 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,720 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:19:54,721 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.042) 0:06:14.500 ******* >2018-08-30 12:19:54,755 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,769 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:19:54,769 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.048) 0:06:14.549 ******* >2018-08-30 12:19:54,807 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,820 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:19:54,820 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.050) 0:06:14.599 ******* >2018-08-30 12:19:54,848 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,867 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:19:54,868 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.047) 0:06:14.647 ******* >2018-08-30 12:19:54,897 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,911 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:19:54,911 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.043) 0:06:14.690 ******* >2018-08-30 12:19:54,939 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:54,954 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:19:54,954 p=14044 u=mistral | Thursday 30 August 2018 12:19:54 -0400 (0:00:00.043) 0:06:14.733 ******* >2018-08-30 12:19:54,988 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:55,003 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:19:55,003 p=14044 u=mistral | Thursday 30 August 2018 12:19:55 -0400 (0:00:00.049) 0:06:14.783 ******* >2018-08-30 12:19:55,037 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:55,051 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:19:55,052 p=14044 u=mistral | Thursday 30 August 2018 12:19:55 -0400 (0:00:00.048) 0:06:14.831 ******* >2018-08-30 12:19:55,083 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:55,096 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:19:55,096 p=14044 u=mistral | Thursday 30 August 2018 12:19:55 -0400 (0:00:00.044) 0:06:14.875 ******* >2018-08-30 12:19:55,432 p=14044 u=mistral | ok: [172.16.0.28] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:19:55,738 p=14044 u=mistral | ok: [172.16.0.28] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:19:55,755 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:19:55,755 p=14044 u=mistral | Thursday 30 August 2018 12:19:55 -0400 (0:00:00.659) 0:06:15.535 ******* >2018-08-30 12:19:55,820 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:55,840 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:19:55,840 p=14044 u=mistral | Thursday 30 August 2018 12:19:55 -0400 (0:00:00.084) 0:06:15.619 ******* >2018-08-30 12:19:55,867 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:55,883 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:19:55,884 p=14044 u=mistral | Thursday 30 August 2018 12:19:55 -0400 (0:00:00.043) 0:06:15.663 ******* >2018-08-30 12:19:56,234 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:56,249 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:19:56,249 p=14044 u=mistral | Thursday 30 August 2018 12:19:56 -0400 (0:00:00.365) 0:06:16.028 ******* >2018-08-30 12:19:56,318 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:56,331 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:19:56,331 p=14044 u=mistral | Thursday 30 August 2018 12:19:56 -0400 (0:00:00.081) 0:06:16.110 ******* >2018-08-30 12:19:56,698 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:56,713 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:19:56,713 p=14044 u=mistral | Thursday 30 August 2018 12:19:56 -0400 (0:00:00.382) 0:06:16.493 ******* >2018-08-30 12:19:56,754 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:56,774 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:19:56,774 p=14044 u=mistral | Thursday 30 August 2018 12:19:56 -0400 (0:00:00.060) 0:06:16.553 ******* >2018-08-30 12:19:56,832 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.33) >2018-08-30 12:19:56,852 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.24) >2018-08-30 12:19:56,878 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.25) >2018-08-30 12:19:56,901 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:19:56,901 p=14044 u=mistral | Thursday 30 August 2018 12:19:56 -0400 (0:00:00.127) 0:06:16.680 ******* >2018-08-30 12:19:56,943 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:56,962 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:19:56,962 p=14044 u=mistral | Thursday 30 August 2018 12:19:56 -0400 (0:00:00.060) 0:06:16.741 ******* >2018-08-30 12:19:57,004 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,025 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:19:57,025 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.063) 0:06:16.805 ******* >2018-08-30 12:19:57,072 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:19:57,072 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.046) 0:06:16.851 ******* >2018-08-30 12:19:57,119 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:19:57,120 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.047) 0:06:16.899 ******* >2018-08-30 12:19:57,150 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,169 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:19:57,169 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.049) 0:06:16.948 ******* >2018-08-30 12:19:57,196 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,210 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:19:57,211 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.041) 0:06:16.990 ******* >2018-08-30 12:19:57,248 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,261 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:19:57,261 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.050) 0:06:17.041 ******* >2018-08-30 12:19:57,294 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,314 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:19:57,315 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.053) 0:06:17.094 ******* >2018-08-30 12:19:57,354 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,372 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:19:57,373 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.058) 0:06:17.152 ******* >2018-08-30 12:19:57,402 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,416 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:19:57,416 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.043) 0:06:17.196 ******* >2018-08-30 12:19:57,446 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,459 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:19:57,459 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.042) 0:06:17.239 ******* >2018-08-30 12:19:57,487 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,500 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:19:57,500 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.041) 0:06:17.280 ******* >2018-08-30 12:19:57,533 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:57,554 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:19:57,554 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.053) 0:06:17.333 ******* >2018-08-30 12:19:57,973 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:57,994 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:19:57,995 p=14044 u=mistral | Thursday 30 August 2018 12:19:57 -0400 (0:00:00.440) 0:06:17.774 ******* >2018-08-30 12:19:58,032 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,046 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:19:58,047 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.051) 0:06:17.826 ******* >2018-08-30 12:19:58,080 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,101 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:19:58,101 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.054) 0:06:17.880 ******* >2018-08-30 12:19:58,135 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,149 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:19:58,149 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.048) 0:06:17.929 ******* >2018-08-30 12:19:58,184 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,198 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:19:58,199 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.049) 0:06:17.978 ******* >2018-08-30 12:19:58,228 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,243 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:19:58,244 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.044) 0:06:18.023 ******* >2018-08-30 12:19:58,282 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,300 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:19:58,301 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.057) 0:06:18.080 ******* >2018-08-30 12:19:58,730 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:58,768 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:19:58,768 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.467) 0:06:18.548 ******* >2018-08-30 12:19:58,800 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,814 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:19:58,815 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.046) 0:06:18.594 ******* >2018-08-30 12:19:58,851 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,865 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:19:58,865 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.050) 0:06:18.644 ******* >2018-08-30 12:19:58,896 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,909 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:19:58,909 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.044) 0:06:18.688 ******* >2018-08-30 12:19:58,941 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:58,958 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:19:58,959 p=14044 u=mistral | Thursday 30 August 2018 12:19:58 -0400 (0:00:00.049) 0:06:18.738 ******* >2018-08-30 12:19:58,994 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:59,012 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:19:59,012 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.053) 0:06:18.791 ******* >2018-08-30 12:19:59,053 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:59,070 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:19:59,071 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.058) 0:06:18.850 ******* >2018-08-30 12:19:59,144 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:59,163 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:19:59,163 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.092) 0:06:18.943 ******* >2018-08-30 12:19:59,196 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:59,215 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:19:59,215 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.051) 0:06:18.994 ******* >2018-08-30 12:19:59,247 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:59,267 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:19:59,267 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.052) 0:06:19.046 ******* >2018-08-30 12:19:59,303 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:59,319 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:19:59,320 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.052) 0:06:19.099 ******* >2018-08-30 12:19:59,361 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:59,374 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:19:59,374 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.054) 0:06:19.153 ******* >2018-08-30 12:19:59,407 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:19:59,423 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:19:59,423 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.048) 0:06:19.202 ******* >2018-08-30 12:19:59,829 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:19:59,845 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:19:59,846 p=14044 u=mistral | Thursday 30 August 2018 12:19:59 -0400 (0:00:00.422) 0:06:19.625 ******* >2018-08-30 12:20:00,256 p=14044 u=mistral | changed: [172.16.0.28] >2018-08-30 12:20:00,276 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:20:00,276 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.430) 0:06:20.055 ******* >2018-08-30 12:20:00,358 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:00,376 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:20:00,376 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.100) 0:06:20.156 ******* >2018-08-30 12:20:00,416 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,430 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:20:00,430 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.053) 0:06:20.209 ******* >2018-08-30 12:20:00,471 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,484 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:20:00,484 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.053) 0:06:20.263 ******* >2018-08-30 12:20:00,515 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,527 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:20:00,528 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.043) 0:06:20.307 ******* >2018-08-30 12:20:00,563 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,578 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:20:00,578 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.050) 0:06:20.357 ******* >2018-08-30 12:20:00,609 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,630 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:20:00,630 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.051) 0:06:20.409 ******* >2018-08-30 12:20:00,663 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,677 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:20:00,677 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.047) 0:06:20.457 ******* >2018-08-30 12:20:00,706 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,727 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:20:00,727 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.049) 0:06:20.506 ******* >2018-08-30 12:20:00,759 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,774 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:20:00,774 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.047) 0:06:20.553 ******* >2018-08-30 12:20:00,807 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,826 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:20:00,827 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.052) 0:06:20.606 ******* >2018-08-30 12:20:00,860 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,874 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:20:00,874 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.047) 0:06:20.653 ******* >2018-08-30 12:20:00,901 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:00,915 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:20:00,915 p=14044 u=mistral | Thursday 30 August 2018 12:20:00 -0400 (0:00:00.040) 0:06:20.694 ******* >2018-08-30 12:20:01,868 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:01,887 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:20:01,888 p=14044 u=mistral | Thursday 30 August 2018 12:20:01 -0400 (0:00:00.972) 0:06:21.667 ******* >2018-08-30 12:20:01,944 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:01,958 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:20:01,958 p=14044 u=mistral | Thursday 30 August 2018 12:20:01 -0400 (0:00:00.070) 0:06:21.738 ******* >2018-08-30 12:20:01,990 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:02,003 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:20:02,003 p=14044 u=mistral | Thursday 30 August 2018 12:20:02 -0400 (0:00:00.044) 0:06:21.782 ******* >2018-08-30 12:20:02,036 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:02,051 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:20:02,052 p=14044 u=mistral | Thursday 30 August 2018 12:20:02 -0400 (0:00:00.048) 0:06:21.831 ******* >2018-08-30 12:20:02,134 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:02,148 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:20:02,148 p=14044 u=mistral | Thursday 30 August 2018 12:20:02 -0400 (0:00:00.096) 0:06:21.927 ******* >2018-08-30 12:20:02,182 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:02,195 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:20:02,195 p=14044 u=mistral | Thursday 30 August 2018 12:20:02 -0400 (0:00:00.046) 0:06:21.974 ******* >2018-08-30 12:20:02,229 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:02,243 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:20:02,243 p=14044 u=mistral | Thursday 30 August 2018 12:20:02 -0400 (0:00:00.047) 0:06:22.022 ******* >2018-08-30 12:20:02,595 p=14044 u=mistral | changed: [172.16.0.28] => (item=/etc/ceph) >2018-08-30 12:20:02,907 p=14044 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:20:03,206 p=14044 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:20:03,648 p=14044 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:20:03,931 p=14044 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:20:03,947 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:20:03,947 p=14044 u=mistral | Thursday 30 August 2018 12:20:03 -0400 (0:00:01.703) 0:06:23.726 ******* >2018-08-30 12:20:03,976 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:03,991 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:20:03,991 p=14044 u=mistral | Thursday 30 August 2018 12:20:03 -0400 (0:00:00.044) 0:06:23.771 ******* >2018-08-30 12:20:04,024 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:04,043 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:20:04,043 p=14044 u=mistral | Thursday 30 August 2018 12:20:04 -0400 (0:00:00.051) 0:06:23.822 ******* >2018-08-30 12:20:04,089 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:04,108 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:20:04,108 p=14044 u=mistral | Thursday 30 August 2018 12:20:04 -0400 (0:00:00.065) 0:06:23.887 ******* >2018-08-30 12:20:04,142 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:04,161 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:20:04,161 p=14044 u=mistral | Thursday 30 August 2018 12:20:04 -0400 (0:00:00.052) 0:06:23.940 ******* >2018-08-30 12:20:04,193 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:04,208 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:20:04,208 p=14044 u=mistral | Thursday 30 August 2018 12:20:04 -0400 (0:00:00.047) 0:06:23.987 ******* >2018-08-30 12:20:04,556 p=14044 u=mistral | changed: [172.16.0.28] >2018-08-30 12:20:04,576 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:20:04,576 p=14044 u=mistral | Thursday 30 August 2018 12:20:04 -0400 (0:00:00.368) 0:06:24.356 ******* >2018-08-30 12:20:07,175 p=14044 u=mistral | changed: [172.16.0.28] >2018-08-30 12:20:07,186 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:20:07,186 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:02.610) 0:06:26.966 ******* >2018-08-30 12:20:07,213 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,234 p=14044 u=mistral | TASK [ceph-osd : make sure public_network configured] ************************** >2018-08-30 12:20:07,234 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.047) 0:06:27.013 ******* >2018-08-30 12:20:07,264 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,279 p=14044 u=mistral | TASK [ceph-osd : make sure cluster_network configured] ************************* >2018-08-30 12:20:07,279 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.044) 0:06:27.058 ******* >2018-08-30 12:20:07,309 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,322 p=14044 u=mistral | TASK [ceph-osd : make sure journal_size configured] **************************** >2018-08-30 12:20:07,323 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.043) 0:06:27.102 ******* >2018-08-30 12:20:07,355 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,371 p=14044 u=mistral | TASK [ceph-osd : make sure an osd scenario was chosen] ************************* >2018-08-30 12:20:07,372 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.049) 0:06:27.151 ******* >2018-08-30 12:20:07,408 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,426 p=14044 u=mistral | TASK [ceph-osd : make sure a valid osd scenario was chosen] ******************** >2018-08-30 12:20:07,426 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.054) 0:06:27.205 ******* >2018-08-30 12:20:07,460 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,477 p=14044 u=mistral | TASK [ceph-osd : verify devices have been provided] **************************** >2018-08-30 12:20:07,477 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.051) 0:06:27.257 ******* >2018-08-30 12:20:07,531 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,547 p=14044 u=mistral | TASK [ceph-osd : check if osd_scenario lvm is supported by the selected ceph version] *** >2018-08-30 12:20:07,547 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.069) 0:06:27.326 ******* >2018-08-30 12:20:07,585 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,598 p=14044 u=mistral | TASK [ceph-osd : verify lvm_volumes have been provided] ************************ >2018-08-30 12:20:07,598 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.050) 0:06:27.377 ******* >2018-08-30 12:20:07,634 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,647 p=14044 u=mistral | TASK [ceph-osd : make sure the lvm_volumes variable is a list] ***************** >2018-08-30 12:20:07,647 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.049) 0:06:27.426 ******* >2018-08-30 12:20:07,688 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,702 p=14044 u=mistral | TASK [ceph-osd : make sure the devices variable is a list] ********************* >2018-08-30 12:20:07,702 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.054) 0:06:27.481 ******* >2018-08-30 12:20:07,741 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,754 p=14044 u=mistral | TASK [ceph-osd : verify dedicated devices have been provided] ****************** >2018-08-30 12:20:07,754 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.051) 0:06:27.533 ******* >2018-08-30 12:20:07,787 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,799 p=14044 u=mistral | TASK [ceph-osd : make sure the dedicated_devices variable is a list] *********** >2018-08-30 12:20:07,799 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.045) 0:06:27.578 ******* >2018-08-30 12:20:07,832 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,845 p=14044 u=mistral | TASK [ceph-osd : check if bluestore is supported by the selected ceph version] *** >2018-08-30 12:20:07,845 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.046) 0:06:27.625 ******* >2018-08-30 12:20:07,881 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:07,896 p=14044 u=mistral | TASK [ceph-osd : include system_tuning.yml] ************************************ >2018-08-30 12:20:07,896 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.050) 0:06:27.675 ******* >2018-08-30 12:20:07,947 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/system_tuning.yml for 172.16.0.28 >2018-08-30 12:20:07,987 p=14044 u=mistral | TASK [ceph-osd : disable osd directory parsing by updatedb] ******************** >2018-08-30 12:20:07,987 p=14044 u=mistral | Thursday 30 August 2018 12:20:07 -0400 (0:00:00.091) 0:06:27.766 ******* >2018-08-30 12:20:08,012 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:08,024 p=14044 u=mistral | TASK [ceph-osd : disable osd directory path in updatedb.conf] ****************** >2018-08-30 12:20:08,024 p=14044 u=mistral | Thursday 30 August 2018 12:20:08 -0400 (0:00:00.036) 0:06:27.803 ******* >2018-08-30 12:20:08,052 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:08,064 p=14044 u=mistral | TASK [ceph-osd : create tmpfiles.d directory] ********************************** >2018-08-30 12:20:08,065 p=14044 u=mistral | Thursday 30 August 2018 12:20:08 -0400 (0:00:00.040) 0:06:27.844 ******* >2018-08-30 12:20:08,402 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:08,415 p=14044 u=mistral | TASK [ceph-osd : disable transparent hugepage] ********************************* >2018-08-30 12:20:08,415 p=14044 u=mistral | Thursday 30 August 2018 12:20:08 -0400 (0:00:00.350) 0:06:28.194 ******* >2018-08-30 12:20:09,167 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:09,179 p=14044 u=mistral | TASK [ceph-osd : get default vm.min_free_kbytes] ******************************* >2018-08-30 12:20:09,180 p=14044 u=mistral | Thursday 30 August 2018 12:20:09 -0400 (0:00:00.764) 0:06:28.959 ******* >2018-08-30 12:20:09,499 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:09,515 p=14044 u=mistral | TASK [ceph-osd : set_fact vm_min_free_kbytes] ********************************** >2018-08-30 12:20:09,515 p=14044 u=mistral | Thursday 30 August 2018 12:20:09 -0400 (0:00:00.335) 0:06:29.294 ******* >2018-08-30 12:20:09,577 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:09,592 p=14044 u=mistral | TASK [ceph-osd : apply operating system tuning] ******************************** >2018-08-30 12:20:09,592 p=14044 u=mistral | Thursday 30 August 2018 12:20:09 -0400 (0:00:00.077) 0:06:29.372 ******* >2018-08-30 12:20:10,292 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'enable': u"(osd_objectstore == 'bluestore')", u'name': u'fs.aio-max-nr', u'value': u'1048576'}) >2018-08-30 12:20:10,618 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'name': u'fs.file-max', u'value': 26234859}) >2018-08-30 12:20:10,928 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'name': u'vm.zone_reclaim_mode', u'value': 0}) >2018-08-30 12:20:11,223 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'name': u'vm.swappiness', u'value': 10}) >2018-08-30 12:20:11,549 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'name': u'vm.min_free_kbytes', u'value': u'67584'}) >2018-08-30 12:20:11,568 p=14044 u=mistral | TASK [ceph-osd : install dependencies] ***************************************** >2018-08-30 12:20:11,568 p=14044 u=mistral | Thursday 30 August 2018 12:20:11 -0400 (0:00:01.976) 0:06:31.348 ******* >2018-08-30 12:20:11,596 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:11,609 p=14044 u=mistral | TASK [ceph-osd : include common.yml] ******************************************* >2018-08-30 12:20:11,609 p=14044 u=mistral | Thursday 30 August 2018 12:20:11 -0400 (0:00:00.040) 0:06:31.389 ******* >2018-08-30 12:20:11,647 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/common.yml for 172.16.0.28 >2018-08-30 12:20:11,688 p=14044 u=mistral | TASK [ceph-osd : create bootstrap-osd and osd directories] ********************* >2018-08-30 12:20:11,689 p=14044 u=mistral | Thursday 30 August 2018 12:20:11 -0400 (0:00:00.079) 0:06:31.468 ******* >2018-08-30 12:20:12,023 p=14044 u=mistral | changed: [172.16.0.28] => (item=/var/lib/ceph/bootstrap-osd/) >2018-08-30 12:20:12,329 p=14044 u=mistral | ok: [172.16.0.28] => (item=/var/lib/ceph/osd/) >2018-08-30 12:20:12,349 p=14044 u=mistral | TASK [ceph-osd : copy ceph key(s) if needed] *********************************** >2018-08-30 12:20:12,349 p=14044 u=mistral | Thursday 30 August 2018 12:20:12 -0400 (0:00:00.660) 0:06:32.128 ******* >2018-08-30 12:20:13,045 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'name': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'copy_key': True}) >2018-08-30 12:20:13,058 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:20:13,081 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore'] *** >2018-08-30 12:20:13,082 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.732) 0:06:32.861 ******* >2018-08-30 12:20:13,111 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,125 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options 'ceph_disk_cli_options'] ******* >2018-08-30 12:20:13,125 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.043) 0:06:32.904 ******* >2018-08-30 12:20:13,168 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,186 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph'] ************** >2018-08-30 12:20:13,187 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.061) 0:06:32.966 ******* >2018-08-30 12:20:13,229 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,243 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore --dmcrypt'] *** >2018-08-30 12:20:13,243 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.056) 0:06:33.022 ******* >2018-08-30 12:20:13,273 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,288 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --filestore --dmcrypt'] *** >2018-08-30 12:20:13,289 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.045) 0:06:33.068 ******* >2018-08-30 12:20:13,323 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,338 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --dmcrypt'] **** >2018-08-30 12:20:13,338 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.049) 0:06:33.117 ******* >2018-08-30 12:20:13,377 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,393 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e KV_TYPE=etcd -e KV_IP=127.0.0.1 -e KV_PORT=2379'] *** >2018-08-30 12:20:13,393 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.055) 0:06:33.172 ******* >2018-08-30 12:20:13,418 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,430 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:20:13,430 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.037) 0:06:33.210 ******* >2018-08-30 12:20:13,502 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:13,515 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:20:13,516 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.085) 0:06:33.295 ******* >2018-08-30 12:20:13,550 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,566 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:20:13,566 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.050) 0:06:33.345 ******* >2018-08-30 12:20:13,598 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,613 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:20:13,613 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.047) 0:06:33.392 ******* >2018-08-30 12:20:13,644 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,658 p=14044 u=mistral | TASK [ceph-osd : set_fact devices generate device list when osd_auto_discovery] *** >2018-08-30 12:20:13,658 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.044) 0:06:33.437 ******* >2018-08-30 12:20:13,701 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vda1': {u'sectorsize': 512, u'uuid': u'2018-08-02-20-03-08-00', u'links': {u'masters': [], u'labels': [u'config-2'], u'ids': [], u'uuids': [u'2018-08-02-20-03-08-00']}, u'sectors': u'2048', u'start': u'2048', u'holders': [], u'size': u'1.00 MB'}, u'vda2': {u'sectorsize': 512, u'uuid': u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2', u'links': {u'masters': [], u'labels': [u'img-rootfs'], u'ids': [], u'uuids': [u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2']}, u'sectors': u'209711071', u'start': u'4096', u'holders': [], u'size': u'100.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vda'}) >2018-08-30 12:20:13,708 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vdb1': {u'sectorsize': 512, u'uuid': u'c9d8ebb9-7706-48e7-b732-4218bfe9ca0a', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': [u'c9d8ebb9-7706-48e7-b732-4218bfe9ca0a']}, u'sectors': u'199227359', u'start': u'10487808', u'holders': [], u'size': u'95.00 GB'}, u'vdb2': {u'sectorsize': 512, u'uuid': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'10485760', u'start': u'2048', u'holders': [], u'size': u'5.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vdb'}) >2018-08-30 12:20:13,726 p=14044 u=mistral | TASK [ceph-osd : resolve dedicated device link(s)] ***************************** >2018-08-30 12:20:13,726 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.068) 0:06:33.505 ******* >2018-08-30 12:20:13,775 p=14044 u=mistral | TASK [ceph-osd : set_fact build dedicated_devices from resolved symlinks] ****** >2018-08-30 12:20:13,775 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.048) 0:06:33.554 ******* >2018-08-30 12:20:13,815 p=14044 u=mistral | TASK [ceph-osd : set_fact build final dedicated_devices list] ****************** >2018-08-30 12:20:13,815 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.040) 0:06:33.595 ******* >2018-08-30 12:20:13,843 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:13,857 p=14044 u=mistral | TASK [ceph-osd : read information about the devices] *************************** >2018-08-30 12:20:13,857 p=14044 u=mistral | Thursday 30 August 2018 12:20:13 -0400 (0:00:00.041) 0:06:33.636 ******* >2018-08-30 12:20:14,616 p=14044 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:20:14,635 p=14044 u=mistral | TASK [ceph-osd : check the partition status of the osd disks] ****************** >2018-08-30 12:20:14,635 p=14044 u=mistral | Thursday 30 August 2018 12:20:14 -0400 (0:00:00.777) 0:06:34.414 ******* >2018-08-30 12:20:14,987 p=14044 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:20:15,004 p=14044 u=mistral | TASK [ceph-osd : create gpt disk label] **************************************** >2018-08-30 12:20:15,004 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.369) 0:06:34.783 ******* >2018-08-30 12:20:15,063 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'blkid', u'-t', u'PTTYPE=gpt', u'/dev/vdb'], u'end': u'2018-08-30 12:20:15.935960', '_ansible_no_log': False, u'stdout': u'/dev/vdb: PTTYPE="gpt" ', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.008848', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'blkid -t PTTYPE="gpt" /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb: PTTYPE="gpt" '], 'failed_when_result': False, u'start': u'2018-08-30 12:20:15.927112', '_ansible_ignore_errors': None, 'failed': False}, u'/dev/vdb']) >2018-08-30 12:20:15,080 p=14044 u=mistral | TASK [ceph-osd : include scenarios/collocated.yml] ***************************** >2018-08-30 12:20:15,081 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.076) 0:06:34.860 ******* >2018-08-30 12:20:15,144 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/scenarios/collocated.yml for 172.16.0.28 >2018-08-30 12:20:15,197 p=14044 u=mistral | TASK [ceph-osd : prepare ceph containerized osd disk collocated] *************** >2018-08-30 12:20:15,197 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.116) 0:06:34.976 ******* >2018-08-30 12:20:15,250 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:20:15,265 p=14044 u=mistral | TASK [ceph-osd : automatic prepare ceph containerized osd disk collocated] ***** >2018-08-30 12:20:15,265 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.068) 0:06:35.044 ******* >2018-08-30 12:20:15,306 p=14044 u=mistral | skipping: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:20:15,321 p=14044 u=mistral | TASK [ceph-osd : manually prepare ceph "filestore" non-containerized osd disk(s) with collocated osd data and journal] *** >2018-08-30 12:20:15,322 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.056) 0:06:35.101 ******* >2018-08-30 12:20:15,367 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:20:15,386 p=14044 u=mistral | TASK [ceph-osd : include scenarios/non-collocated.yml] ************************* >2018-08-30 12:20:15,387 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.064) 0:06:35.166 ******* >2018-08-30 12:20:15,420 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:15,434 p=14044 u=mistral | TASK [ceph-osd : include scenarios/lvm.yml] ************************************ >2018-08-30 12:20:15,434 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.047) 0:06:35.213 ******* >2018-08-30 12:20:15,462 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:15,476 p=14044 u=mistral | TASK [ceph-osd : include activate_osds.yml] ************************************ >2018-08-30 12:20:15,477 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.042) 0:06:35.256 ******* >2018-08-30 12:20:15,513 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:15,527 p=14044 u=mistral | TASK [ceph-osd : include start_osds.yml] *************************************** >2018-08-30 12:20:15,528 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.050) 0:06:35.307 ******* >2018-08-30 12:20:15,555 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:15,570 p=14044 u=mistral | TASK [ceph-osd : include docker/main.yml] ************************************** >2018-08-30 12:20:15,571 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.042) 0:06:35.350 ******* >2018-08-30 12:20:15,614 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/main.yml for 172.16.0.28 >2018-08-30 12:20:15,684 p=14044 u=mistral | TASK [ceph-osd : include start_docker_osd.yml] ********************************* >2018-08-30 12:20:15,685 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.113) 0:06:35.464 ******* >2018-08-30 12:20:15,729 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/start_docker_osd.yml for 172.16.0.28 >2018-08-30 12:20:15,743 p=14044 u=mistral | TASK [ceph-osd : umount ceph disk (if on openstack)] *************************** >2018-08-30 12:20:15,743 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.058) 0:06:35.522 ******* >2018-08-30 12:20:15,767 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:15,780 p=14044 u=mistral | TASK [ceph-osd : test if the container image has the disk_list function] ******* >2018-08-30 12:20:15,780 p=14044 u=mistral | Thursday 30 August 2018 12:20:15 -0400 (0:00:00.037) 0:06:35.560 ******* >2018-08-30 12:20:16,697 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:16,714 p=14044 u=mistral | TASK [ceph-osd : generate ceph osd docker run script] ************************** >2018-08-30 12:20:16,714 p=14044 u=mistral | Thursday 30 August 2018 12:20:16 -0400 (0:00:00.933) 0:06:36.493 ******* >2018-08-30 12:20:17,741 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:17,753 p=14044 u=mistral | TASK [ceph-osd : generate systemd unit file] *********************************** >2018-08-30 12:20:17,753 p=14044 u=mistral | Thursday 30 August 2018 12:20:17 -0400 (0:00:01.039) 0:06:37.533 ******* >2018-08-30 12:20:18,785 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:18,798 p=14044 u=mistral | TASK [ceph-osd : systemd start osd container] ********************************** >2018-08-30 12:20:18,798 p=14044 u=mistral | Thursday 30 August 2018 12:20:18 -0400 (0:00:01.044) 0:06:38.577 ******* >2018-08-30 12:20:19,287 p=14044 u=mistral | ok: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:20:19,304 p=14044 u=mistral | TASK [ceph-osd : set_fact openstack_keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:20:19,305 p=14044 u=mistral | Thursday 30 August 2018 12:20:19 -0400 (0:00:00.506) 0:06:39.084 ******* >2018-08-30 12:20:19,373 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:20:19,580 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:20:19,609 p=14044 u=mistral | ok: [172.16.0.28] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:20:19,624 p=14044 u=mistral | TASK [ceph-osd : set_fact keys - override keys_tmp with keys] ****************** >2018-08-30 12:20:19,625 p=14044 u=mistral | Thursday 30 August 2018 12:20:19 -0400 (0:00:00.320) 0:06:39.404 ******* >2018-08-30 12:20:19,883 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:19,909 p=14044 u=mistral | TASK [ceph-osd : wait for all osd to be up] ************************************ >2018-08-30 12:20:19,909 p=14044 u=mistral | Thursday 30 August 2018 12:20:19 -0400 (0:00:00.284) 0:06:39.689 ******* >2018-08-30 12:20:19,943 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:19,981 p=14044 u=mistral | TASK [ceph-osd : list existing pool(s)] **************************************** >2018-08-30 12:20:19,981 p=14044 u=mistral | Thursday 30 August 2018 12:20:19 -0400 (0:00:00.071) 0:06:39.760 ******* >2018-08-30 12:20:20,023 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,033 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,045 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,057 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,071 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,111 p=14044 u=mistral | TASK [ceph-osd : create openstack pool(s)] ************************************* >2018-08-30 12:20:20,112 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.130) 0:06:39.891 ******* >2018-08-30 12:20:20,161 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:20:20,172 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:20:20,183 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:20:20,196 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:20:20,208 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:20:20,251 p=14044 u=mistral | TASK [ceph-osd : assign application to pool(s)] ******************************** >2018-08-30 12:20:20,251 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.139) 0:06:40.030 ******* >2018-08-30 12:20:20,298 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,309 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,321 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,334 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,345 p=14044 u=mistral | skipping: [172.16.0.28] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:20:20,380 p=14044 u=mistral | TASK [ceph-osd : create openstack cephx key(s)] ******************************** >2018-08-30 12:20:20,380 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.128) 0:06:40.159 ******* >2018-08-30 12:20:20,426 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:20:20,433 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:20:20,446 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:20:20,479 p=14044 u=mistral | TASK [ceph-osd : fetch openstack cephx key(s)] ********************************* >2018-08-30 12:20:20,479 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.098) 0:06:40.258 ******* >2018-08-30 12:20:20,526 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:20:20,539 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:20:20,551 p=14044 u=mistral | skipping: [172.16.0.28] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:20:20,625 p=14044 u=mistral | TASK [ceph-osd : copy to other mons the openstack cephx key(s)] **************** >2018-08-30 12:20:20,626 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.146) 0:06:40.405 ******* >2018-08-30 12:20:20,683 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.33', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:20:20,699 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.33', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:20:20,713 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.33', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:20:20,726 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.24', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:20:20,746 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.24', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:20:20,752 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.24', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:20:20,766 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.25', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:20:20,777 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.25', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:20:20,789 p=14044 u=mistral | skipping: [172.16.0.28] => (item=[u'172.16.0.25', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:20:20,794 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:20:20,795 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.168) 0:06:40.574 ******* >2018-08-30 12:20:20,872 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:20,873 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:20:20,873 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.078) 0:06:40.652 ******* >2018-08-30 12:20:20,916 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:20,916 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:20:20,917 p=14044 u=mistral | Thursday 30 August 2018 12:20:20 -0400 (0:00:00.043) 0:06:40.696 ******* >2018-08-30 12:20:21,004 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.33) >2018-08-30 12:20:21,010 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.24) >2018-08-30 12:20:21,017 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.25) >2018-08-30 12:20:21,019 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:20:21,019 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.102) 0:06:40.798 ******* >2018-08-30 12:20:21,127 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.33) >2018-08-30 12:20:21,132 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.24) >2018-08-30 12:20:21,140 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.25) >2018-08-30 12:20:21,142 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:20:21,142 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.122) 0:06:40.921 ******* >2018-08-30 12:20:21,210 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:21,211 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:20:21,212 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.069) 0:06:40.991 ******* >2018-08-30 12:20:21,285 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:21,286 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:20:21,286 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.074) 0:06:41.066 ******* >2018-08-30 12:20:21,333 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:21,334 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:20:21,334 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.047) 0:06:41.113 ******* >2018-08-30 12:20:21,418 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:20:21,426 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.36) >2018-08-30 12:20:21,434 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.32) >2018-08-30 12:20:21,437 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:20:21,437 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.103) 0:06:41.216 ******* >2018-08-30 12:20:21,536 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.28) >2018-08-30 12:20:21,544 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.36) >2018-08-30 12:20:21,564 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.32) >2018-08-30 12:20:21,565 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:20:21,566 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.128) 0:06:41.345 ******* >2018-08-30 12:20:21,635 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:21,636 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:20:21,636 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.070) 0:06:41.416 ******* >2018-08-30 12:20:21,705 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:21,706 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:20:21,706 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.070) 0:06:41.486 ******* >2018-08-30 12:20:21,753 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:21,754 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:20:21,754 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.047) 0:06:41.534 ******* >2018-08-30 12:20:21,804 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:20:21,805 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.050) 0:06:41.584 ******* >2018-08-30 12:20:21,853 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:20:21,854 p=14044 u=mistral | Thursday 30 August 2018 12:20:21 -0400 (0:00:00.049) 0:06:41.633 ******* >2018-08-30 12:20:22,137 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:22,138 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:20:22,139 p=14044 u=mistral | Thursday 30 August 2018 12:20:22 -0400 (0:00:00.284) 0:06:41.918 ******* >2018-08-30 12:20:22,410 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:22,411 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:20:22,411 p=14044 u=mistral | Thursday 30 August 2018 12:20:22 -0400 (0:00:00.272) 0:06:42.190 ******* >2018-08-30 12:20:22,456 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:22,457 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:20:22,458 p=14044 u=mistral | Thursday 30 August 2018 12:20:22 -0400 (0:00:00.046) 0:06:42.237 ******* >2018-08-30 12:20:22,507 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:20:22,507 p=14044 u=mistral | Thursday 30 August 2018 12:20:22 -0400 (0:00:00.049) 0:06:42.286 ******* >2018-08-30 12:20:22,552 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:20:22,553 p=14044 u=mistral | Thursday 30 August 2018 12:20:22 -0400 (0:00:00.045) 0:06:42.332 ******* >2018-08-30 12:20:22,818 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:22,819 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:20:22,819 p=14044 u=mistral | Thursday 30 August 2018 12:20:22 -0400 (0:00:00.265) 0:06:42.598 ******* >2018-08-30 12:20:23,090 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:23,091 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:20:23,091 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.272) 0:06:42.871 ******* >2018-08-30 12:20:23,130 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:23,131 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:20:23,131 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.039) 0:06:42.910 ******* >2018-08-30 12:20:23,171 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:20:23,171 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.040) 0:06:42.951 ******* >2018-08-30 12:20:23,209 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:20:23,210 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.038) 0:06:42.989 ******* >2018-08-30 12:20:23,279 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:23,280 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:20:23,280 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.070) 0:06:43.059 ******* >2018-08-30 12:20:23,350 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:23,351 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:20:23,351 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.071) 0:06:43.131 ******* >2018-08-30 12:20:23,393 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:23,394 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:20:23,394 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.042) 0:06:43.173 ******* >2018-08-30 12:20:23,484 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.33) >2018-08-30 12:20:23,491 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.24) >2018-08-30 12:20:23,499 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.25) >2018-08-30 12:20:23,501 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:20:23,501 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.107) 0:06:43.280 ******* >2018-08-30 12:20:23,593 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.33) >2018-08-30 12:20:23,606 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.24) >2018-08-30 12:20:23,615 p=14044 u=mistral | skipping: [172.16.0.28] => (item=172.16.0.25) >2018-08-30 12:20:23,618 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:20:23,618 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.116) 0:06:43.397 ******* >2018-08-30 12:20:23,679 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:23,691 p=14044 u=mistral | TASK [get osd numbers] ********************************************************* >2018-08-30 12:20:23,692 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.073) 0:06:43.471 ******* >2018-08-30 12:20:23,716 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:23,728 p=14044 u=mistral | TASK [start ceph osd] ********************************************************** >2018-08-30 12:20:23,728 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.036) 0:06:43.508 ******* >2018-08-30 12:20:23,756 p=14044 u=mistral | skipping: [172.16.0.28] >2018-08-30 12:20:23,768 p=14044 u=mistral | TASK [restart containerized ceph osd] ****************************************** >2018-08-30 12:20:23,768 p=14044 u=mistral | Thursday 30 August 2018 12:20:23 -0400 (0:00:00.039) 0:06:43.547 ******* >2018-08-30 12:20:24,534 p=14044 u=mistral | changed: [172.16.0.28] => (item=/dev/vdb) >2018-08-30 12:20:24,553 p=14044 u=mistral | TASK [set_fact docker_exec_cmd_osd] ******************************************** >2018-08-30 12:20:24,553 p=14044 u=mistral | Thursday 30 August 2018 12:20:24 -0400 (0:00:00.785) 0:06:44.332 ******* >2018-08-30 12:20:24,840 p=14044 u=mistral | ok: [172.16.0.28] >2018-08-30 12:20:24,876 p=14044 u=mistral | TASK [get num_pgs - non container] ********************************************* >2018-08-30 12:20:24,876 p=14044 u=mistral | Thursday 30 August 2018 12:20:24 -0400 (0:00:00.323) 0:06:44.656 ******* >2018-08-30 12:20:26,058 p=14044 u=mistral | changed: [172.16.0.28 -> 172.16.0.33] >2018-08-30 12:20:26,084 p=14044 u=mistral | TASK [waiting for clean pgs...] ************************************************ >2018-08-30 12:20:26,085 p=14044 u=mistral | Thursday 30 August 2018 12:20:26 -0400 (0:00:01.208) 0:06:45.864 ******* >2018-08-30 12:20:26,991 p=14044 u=mistral | FAILED - RETRYING: waiting for clean pgs... (40 retries left). >2018-08-30 12:20:57,882 p=14044 u=mistral | changed: [172.16.0.28 -> 172.16.0.33] >2018-08-30 12:20:57,904 p=14044 u=mistral | PLAY [upgrade ceph osds cluster] *********************************************** >2018-08-30 12:20:58,226 p=14044 u=mistral | TASK [get osd numbers] ********************************************************* >2018-08-30 12:20:58,227 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:32.141) 0:07:18.006 ******* >2018-08-30 12:20:58,265 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:58,277 p=14044 u=mistral | TASK [stop ceph osd] *********************************************************** >2018-08-30 12:20:58,277 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:00.050) 0:07:18.056 ******* >2018-08-30 12:20:58,316 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:58,330 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:20:58,331 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:00.053) 0:07:18.110 ******* >2018-08-30 12:20:58,362 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:58,376 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:20:58,377 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:00.046) 0:07:18.156 ******* >2018-08-30 12:20:58,782 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:20:58,795 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:20:58,796 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:00.418) 0:07:18.575 ******* >2018-08-30 12:20:58,833 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:58,846 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:20:58,847 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:00.051) 0:07:18.626 ******* >2018-08-30 12:20:58,876 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:58,889 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:20:58,890 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:00.042) 0:07:18.669 ******* >2018-08-30 12:20:58,929 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:58,951 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:20:58,952 p=14044 u=mistral | Thursday 30 August 2018 12:20:58 -0400 (0:00:00.062) 0:07:18.731 ******* >2018-08-30 12:20:58,996 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,009 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:20:59,009 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.057) 0:07:18.789 ******* >2018-08-30 12:20:59,044 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,063 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:20:59,064 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.054) 0:07:18.843 ******* >2018-08-30 12:20:59,096 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,112 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:20:59,112 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.048) 0:07:18.891 ******* >2018-08-30 12:20:59,146 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,163 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:20:59,164 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.051) 0:07:18.943 ******* >2018-08-30 12:20:59,193 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,208 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:20:59,209 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.044) 0:07:18.988 ******* >2018-08-30 12:20:59,238 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,256 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:20:59,256 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.047) 0:07:19.035 ******* >2018-08-30 12:20:59,287 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,300 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:20:59,300 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.044) 0:07:19.080 ******* >2018-08-30 12:20:59,331 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,344 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:20:59,345 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.044) 0:07:19.124 ******* >2018-08-30 12:20:59,387 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,404 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:20:59,405 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.059) 0:07:19.184 ******* >2018-08-30 12:20:59,437 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,457 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:20:59,458 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.052) 0:07:19.237 ******* >2018-08-30 12:20:59,492 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,508 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:20:59,508 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.050) 0:07:19.287 ******* >2018-08-30 12:20:59,539 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,557 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:20:59,557 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.048) 0:07:19.336 ******* >2018-08-30 12:20:59,593 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,606 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:20:59,606 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.049) 0:07:19.385 ******* >2018-08-30 12:20:59,644 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,657 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:20:59,657 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.050) 0:07:19.436 ******* >2018-08-30 12:20:59,686 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,699 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:20:59,699 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.042) 0:07:19.478 ******* >2018-08-30 12:20:59,726 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,740 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:20:59,740 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.041) 0:07:19.520 ******* >2018-08-30 12:20:59,770 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,784 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:20:59,784 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.044) 0:07:19.564 ******* >2018-08-30 12:20:59,813 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,826 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:20:59,827 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.042) 0:07:19.606 ******* >2018-08-30 12:20:59,855 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,869 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:20:59,870 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.042) 0:07:19.649 ******* >2018-08-30 12:20:59,896 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,909 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:20:59,909 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.039) 0:07:19.688 ******* >2018-08-30 12:20:59,938 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,953 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:20:59,954 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.044) 0:07:19.733 ******* >2018-08-30 12:20:59,983 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:20:59,999 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:20:59,999 p=14044 u=mistral | Thursday 30 August 2018 12:20:59 -0400 (0:00:00.045) 0:07:19.779 ******* >2018-08-30 12:21:00,031 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:00,049 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:21:00,050 p=14044 u=mistral | Thursday 30 August 2018 12:21:00 -0400 (0:00:00.050) 0:07:19.829 ******* >2018-08-30 12:21:00,375 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:00,389 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:21:00,389 p=14044 u=mistral | Thursday 30 August 2018 12:21:00 -0400 (0:00:00.339) 0:07:20.169 ******* >2018-08-30 12:21:00,450 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:00,468 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:21:00,468 p=14044 u=mistral | Thursday 30 August 2018 12:21:00 -0400 (0:00:00.078) 0:07:20.247 ******* >2018-08-30 12:21:00,532 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:00,545 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:21:00,545 p=14044 u=mistral | Thursday 30 August 2018 12:21:00 -0400 (0:00:00.076) 0:07:20.324 ******* >2018-08-30 12:21:00,570 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:00,597 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:21:00,597 p=14044 u=mistral | Thursday 30 August 2018 12:21:00 -0400 (0:00:00.051) 0:07:20.376 ******* >2018-08-30 12:21:00,701 p=14044 u=mistral | ok: [172.16.0.36 -> 172.16.0.33] >2018-08-30 12:21:00,731 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:21:00,731 p=14044 u=mistral | Thursday 30 August 2018 12:21:00 -0400 (0:00:00.133) 0:07:20.510 ******* >2018-08-30 12:21:00,770 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:00,792 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:21:00,793 p=14044 u=mistral | Thursday 30 August 2018 12:21:00 -0400 (0:00:00.061) 0:07:20.572 ******* >2018-08-30 12:21:01,047 p=14044 u=mistral | ok: [172.16.0.36 -> localhost] >2018-08-30 12:21:01,064 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:21:01,065 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.272) 0:07:20.844 ******* >2018-08-30 12:21:01,134 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:01,155 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:21:01,156 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.090) 0:07:20.935 ******* >2018-08-30 12:21:01,407 p=14044 u=mistral | ok: [172.16.0.36 -> localhost] >2018-08-30 12:21:01,421 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:21:01,422 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.266) 0:07:21.201 ******* >2018-08-30 12:21:01,452 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:01,466 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:21:01,467 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.044) 0:07:21.246 ******* >2018-08-30 12:21:01,533 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:01,554 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:21:01,554 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.087) 0:07:21.333 ******* >2018-08-30 12:21:01,579 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:01,601 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:21:01,601 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.047) 0:07:21.381 ******* >2018-08-30 12:21:01,629 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:01,650 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:21:01,650 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.048) 0:07:21.429 ******* >2018-08-30 12:21:01,677 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:01,690 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:21:01,691 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.040) 0:07:21.470 ******* >2018-08-30 12:21:01,715 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:01,728 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:21:01,728 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.037) 0:07:21.507 ******* >2018-08-30 12:21:01,793 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:01,806 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:21:01,806 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.077) 0:07:21.585 ******* >2018-08-30 12:21:01,830 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:01,848 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:21:01,848 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.041) 0:07:21.627 ******* >2018-08-30 12:21:01,914 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:01,933 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:21:01,934 p=14044 u=mistral | Thursday 30 August 2018 12:21:01 -0400 (0:00:00.085) 0:07:21.713 ******* >2018-08-30 12:21:02,000 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:02,011 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:21:02,012 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.078) 0:07:21.791 ******* >2018-08-30 12:21:02,071 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:02,083 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:21:02,083 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.071) 0:07:21.862 ******* >2018-08-30 12:21:02,416 p=14044 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:21:02,440 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:21:02,441 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.357) 0:07:22.220 ******* >2018-08-30 12:21:02,520 p=14044 u=mistral | ok: [172.16.0.36] => (item={'_ansible_parsed': True, 'stderr_lines': [], '_ansible_item_result': True, u'end': u'2018-08-30 12:21:03.367894', '_ansible_no_log': False, u'stdout': u'/dev/vdb', u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'rc': 0, 'item': u'/dev/vdb', u'delta': u'0:00:00.006178', u'stderr': u'', u'changed': False, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:21:03.361716', '_ansible_ignore_errors': None, 'failed': False}) >2018-08-30 12:21:02,537 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:21:02,537 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.096) 0:07:22.316 ******* >2018-08-30 12:21:02,609 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:02,621 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:21:02,622 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.084) 0:07:22.401 ******* >2018-08-30 12:21:02,656 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:02,671 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:21:02,672 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.049) 0:07:22.451 ******* >2018-08-30 12:21:02,699 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:02,712 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:21:02,712 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.040) 0:07:22.491 ******* >2018-08-30 12:21:02,751 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:02,764 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:21:02,764 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.052) 0:07:22.544 ******* >2018-08-30 12:21:02,794 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:02,807 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:21:02,807 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.042) 0:07:22.586 ******* >2018-08-30 12:21:02,873 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:02,887 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:21:02,888 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.080) 0:07:22.667 ******* >2018-08-30 12:21:02,962 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:02,974 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:21:02,974 p=14044 u=mistral | Thursday 30 August 2018 12:21:02 -0400 (0:00:00.086) 0:07:22.753 ******* >2018-08-30 12:21:03,323 p=14044 u=mistral | changed: [172.16.0.36] => (item=/etc/ceph) >2018-08-30 12:21:03,613 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/) >2018-08-30 12:21:03,899 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/mon) >2018-08-30 12:21:04,203 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/osd) >2018-08-30 12:21:04,492 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/mds) >2018-08-30 12:21:04,793 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/tmp) >2018-08-30 12:21:05,084 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:21:05,529 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:21:05,819 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:21:06,106 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:21:06,396 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:21:06,670 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/run/ceph) >2018-08-30 12:21:06,690 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:21:06,690 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:03.715) 0:07:26.469 ******* >2018-08-30 12:21:06,716 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:06,732 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:21:06,732 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:00.041) 0:07:26.511 ******* >2018-08-30 12:21:06,760 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:06,773 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:21:06,773 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:00.041) 0:07:26.552 ******* >2018-08-30 12:21:06,799 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:06,813 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:21:06,814 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:00.040) 0:07:26.593 ******* >2018-08-30 12:21:06,841 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:06,854 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:21:06,854 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:00.040) 0:07:26.633 ******* >2018-08-30 12:21:06,881 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:06,895 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:21:06,895 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:00.040) 0:07:26.674 ******* >2018-08-30 12:21:06,922 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:06,935 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:21:06,935 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:00.040) 0:07:26.714 ******* >2018-08-30 12:21:06,963 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:06,975 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:21:06,975 p=14044 u=mistral | Thursday 30 August 2018 12:21:06 -0400 (0:00:00.040) 0:07:26.754 ******* >2018-08-30 12:21:07,001 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,013 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:21:07,013 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.038) 0:07:26.793 ******* >2018-08-30 12:21:07,039 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,056 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:21:07,056 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.042) 0:07:26.835 ******* >2018-08-30 12:21:07,087 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,101 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:21:07,102 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.045) 0:07:26.881 ******* >2018-08-30 12:21:07,130 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,142 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:21:07,143 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.041) 0:07:26.922 ******* >2018-08-30 12:21:07,167 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,179 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:21:07,180 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.037) 0:07:26.959 ******* >2018-08-30 12:21:07,205 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,217 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:21:07,217 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.037) 0:07:26.997 ******* >2018-08-30 12:21:07,243 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,254 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:21:07,254 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.037) 0:07:27.034 ******* >2018-08-30 12:21:07,281 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,293 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:21:07,293 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.038) 0:07:27.072 ******* >2018-08-30 12:21:07,322 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,333 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:21:07,333 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.039) 0:07:27.112 ******* >2018-08-30 12:21:07,357 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,368 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:21:07,368 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.035) 0:07:27.147 ******* >2018-08-30 12:21:07,392 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,404 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:21:07,405 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.036) 0:07:27.184 ******* >2018-08-30 12:21:07,431 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,443 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:21:07,443 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.038) 0:07:27.222 ******* >2018-08-30 12:21:07,468 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,479 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:21:07,479 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.036) 0:07:27.259 ******* >2018-08-30 12:21:07,504 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,515 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:21:07,516 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.035) 0:07:27.295 ******* >2018-08-30 12:21:07,538 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,549 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:21:07,550 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.034) 0:07:27.329 ******* >2018-08-30 12:21:07,575 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,586 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:21:07,587 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.037) 0:07:27.366 ******* >2018-08-30 12:21:07,612 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,624 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:21:07,624 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.037) 0:07:27.403 ******* >2018-08-30 12:21:07,650 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,663 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:21:07,663 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.039) 0:07:27.442 ******* >2018-08-30 12:21:07,690 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,701 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:21:07,701 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.038) 0:07:27.481 ******* >2018-08-30 12:21:07,726 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,740 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-ceph03/keyring already exists] *** >2018-08-30 12:21:07,740 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.038) 0:07:27.519 ******* >2018-08-30 12:21:07,766 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,781 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-ceph03/keyring doesn't exist] *** >2018-08-30 12:21:07,781 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.040) 0:07:27.560 ******* >2018-08-30 12:21:07,808 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,823 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:21:07,823 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.042) 0:07:27.602 ******* >2018-08-30 12:21:07,853 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,865 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:21:07,865 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.042) 0:07:27.645 ******* >2018-08-30 12:21:07,897 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,909 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:21:07,909 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.043) 0:07:27.689 ******* >2018-08-30 12:21:07,936 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,956 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:21:07,957 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.047) 0:07:27.736 ******* >2018-08-30 12:21:07,985 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:07,997 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:21:07,998 p=14044 u=mistral | Thursday 30 August 2018 12:21:07 -0400 (0:00:00.040) 0:07:27.777 ******* >2018-08-30 12:21:08,026 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,038 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:21:08,038 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.040) 0:07:27.817 ******* >2018-08-30 12:21:08,070 p=14044 u=mistral | skipping: [172.16.0.36] => (item=/var/run/ceph) >2018-08-30 12:21:08,077 p=14044 u=mistral | skipping: [172.16.0.36] => (item=/var/log/ceph) >2018-08-30 12:21:08,090 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:21:08,090 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.052) 0:07:27.869 ******* >2018-08-30 12:21:08,116 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,128 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:21:08,129 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.038) 0:07:27.908 ******* >2018-08-30 12:21:08,156 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,169 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:21:08,169 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.040) 0:07:27.948 ******* >2018-08-30 12:21:08,198 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,212 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:21:08,212 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.042) 0:07:27.991 ******* >2018-08-30 12:21:08,236 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,249 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:21:08,250 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.037) 0:07:28.029 ******* >2018-08-30 12:21:08,276 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,290 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:21:08,291 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.041) 0:07:28.070 ******* >2018-08-30 12:21:08,321 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,332 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:21:08,333 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.041) 0:07:28.112 ******* >2018-08-30 12:21:08,359 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,371 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:21:08,372 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.038) 0:07:28.151 ******* >2018-08-30 12:21:08,399 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,413 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:21:08,414 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.041) 0:07:28.193 ******* >2018-08-30 12:21:08,445 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:08,461 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:21:08,462 p=14044 u=mistral | Thursday 30 August 2018 12:21:08 -0400 (0:00:00.048) 0:07:28.241 ******* >2018-08-30 12:21:08,814 p=14044 u=mistral | ok: [172.16.0.36] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:21:09,126 p=14044 u=mistral | ok: [172.16.0.36] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:21:09,141 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:21:09,141 p=14044 u=mistral | Thursday 30 August 2018 12:21:09 -0400 (0:00:00.679) 0:07:28.920 ******* >2018-08-30 12:21:09,216 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:09,238 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:21:09,238 p=14044 u=mistral | Thursday 30 August 2018 12:21:09 -0400 (0:00:00.096) 0:07:29.017 ******* >2018-08-30 12:21:09,266 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:09,280 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:21:09,280 p=14044 u=mistral | Thursday 30 August 2018 12:21:09 -0400 (0:00:00.042) 0:07:29.060 ******* >2018-08-30 12:21:09,661 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:09,673 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:21:09,673 p=14044 u=mistral | Thursday 30 August 2018 12:21:09 -0400 (0:00:00.392) 0:07:29.452 ******* >2018-08-30 12:21:09,737 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:09,750 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:21:09,750 p=14044 u=mistral | Thursday 30 August 2018 12:21:09 -0400 (0:00:00.076) 0:07:29.529 ******* >2018-08-30 12:21:10,101 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:10,114 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:21:10,114 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.364) 0:07:29.894 ******* >2018-08-30 12:21:10,157 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,177 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:21:10,177 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.062) 0:07:29.956 ******* >2018-08-30 12:21:10,229 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.33) >2018-08-30 12:21:10,251 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.24) >2018-08-30 12:21:10,274 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.25) >2018-08-30 12:21:10,294 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:21:10,294 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.117) 0:07:30.073 ******* >2018-08-30 12:21:10,334 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,349 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:21:10,350 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.055) 0:07:30.129 ******* >2018-08-30 12:21:10,392 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,410 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:21:10,410 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.060) 0:07:30.189 ******* >2018-08-30 12:21:10,450 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:21:10,450 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.039) 0:07:30.229 ******* >2018-08-30 12:21:10,490 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:21:10,491 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.040) 0:07:30.270 ******* >2018-08-30 12:21:10,516 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,529 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:21:10,529 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.038) 0:07:30.309 ******* >2018-08-30 12:21:10,554 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,568 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:21:10,568 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.038) 0:07:30.347 ******* >2018-08-30 12:21:10,604 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,617 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:21:10,617 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.049) 0:07:30.396 ******* >2018-08-30 12:21:10,653 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,668 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:21:10,668 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.050) 0:07:30.447 ******* >2018-08-30 12:21:10,700 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,714 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:21:10,714 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.046) 0:07:30.494 ******* >2018-08-30 12:21:10,743 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,757 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:21:10,757 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.042) 0:07:30.536 ******* >2018-08-30 12:21:10,785 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,796 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:21:10,797 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.039) 0:07:30.576 ******* >2018-08-30 12:21:10,821 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,833 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:21:10,833 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.036) 0:07:30.612 ******* >2018-08-30 12:21:10,859 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:10,871 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:21:10,871 p=14044 u=mistral | Thursday 30 August 2018 12:21:10 -0400 (0:00:00.037) 0:07:30.650 ******* >2018-08-30 12:21:11,269 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:11,298 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:21:11,298 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.427) 0:07:31.077 ******* >2018-08-30 12:21:11,327 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:11,342 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:21:11,342 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.043) 0:07:31.121 ******* >2018-08-30 12:21:11,372 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:11,385 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:21:11,385 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.043) 0:07:31.164 ******* >2018-08-30 12:21:11,414 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:11,430 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:21:11,430 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.045) 0:07:31.210 ******* >2018-08-30 12:21:11,468 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:11,482 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:21:11,482 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.051) 0:07:31.261 ******* >2018-08-30 12:21:11,509 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:11,523 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:21:11,523 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.040) 0:07:31.302 ******* >2018-08-30 12:21:11,551 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:11,565 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:21:11,565 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.042) 0:07:31.344 ******* >2018-08-30 12:21:11,947 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:11,965 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:21:11,966 p=14044 u=mistral | Thursday 30 August 2018 12:21:11 -0400 (0:00:00.400) 0:07:31.745 ******* >2018-08-30 12:21:11,994 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,006 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:21:12,006 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.040) 0:07:31.785 ******* >2018-08-30 12:21:12,038 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,050 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:21:12,050 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.044) 0:07:31.830 ******* >2018-08-30 12:21:12,080 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,093 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:21:12,094 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.043) 0:07:31.873 ******* >2018-08-30 12:21:12,125 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,139 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:21:12,140 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.045) 0:07:31.919 ******* >2018-08-30 12:21:12,168 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,181 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:21:12,181 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.041) 0:07:31.960 ******* >2018-08-30 12:21:12,214 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,227 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:21:12,227 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.045) 0:07:32.006 ******* >2018-08-30 12:21:12,300 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:12,313 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:21:12,314 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.086) 0:07:32.093 ******* >2018-08-30 12:21:12,342 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,354 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:21:12,355 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.041) 0:07:32.134 ******* >2018-08-30 12:21:12,381 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,393 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:21:12,394 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.038) 0:07:32.173 ******* >2018-08-30 12:21:12,420 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,432 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:21:12,433 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.038) 0:07:32.212 ******* >2018-08-30 12:21:12,461 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,475 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:21:12,475 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.042) 0:07:32.254 ******* >2018-08-30 12:21:12,503 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:12,520 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:21:12,520 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.045) 0:07:32.299 ******* >2018-08-30 12:21:12,879 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:12,894 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:21:12,894 p=14044 u=mistral | Thursday 30 August 2018 12:21:12 -0400 (0:00:00.374) 0:07:32.674 ******* >2018-08-30 12:21:13,240 p=14044 u=mistral | changed: [172.16.0.36] >2018-08-30 12:21:13,258 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:21:13,259 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.364) 0:07:33.038 ******* >2018-08-30 12:21:13,325 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:13,338 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:21:13,338 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.079) 0:07:33.118 ******* >2018-08-30 12:21:13,372 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,385 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:21:13,385 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.047) 0:07:33.165 ******* >2018-08-30 12:21:13,419 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,432 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:21:13,432 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.046) 0:07:33.211 ******* >2018-08-30 12:21:13,460 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,472 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:21:13,472 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.040) 0:07:33.252 ******* >2018-08-30 12:21:13,500 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,512 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:21:13,513 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.040) 0:07:33.292 ******* >2018-08-30 12:21:13,543 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,556 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:21:13,556 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.043) 0:07:33.336 ******* >2018-08-30 12:21:13,588 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,600 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:21:13,600 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.043) 0:07:33.380 ******* >2018-08-30 12:21:13,629 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,647 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:21:13,648 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.047) 0:07:33.427 ******* >2018-08-30 12:21:13,679 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,691 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:21:13,692 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.043) 0:07:33.471 ******* >2018-08-30 12:21:13,720 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,734 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:21:13,734 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.042) 0:07:33.513 ******* >2018-08-30 12:21:13,763 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,777 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:21:13,777 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.043) 0:07:33.556 ******* >2018-08-30 12:21:13,806 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:13,818 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:21:13,818 p=14044 u=mistral | Thursday 30 August 2018 12:21:13 -0400 (0:00:00.041) 0:07:33.598 ******* >2018-08-30 12:21:14,828 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:14,841 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:21:14,842 p=14044 u=mistral | Thursday 30 August 2018 12:21:14 -0400 (0:00:01.023) 0:07:34.621 ******* >2018-08-30 12:21:14,905 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:14,920 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:21:14,920 p=14044 u=mistral | Thursday 30 August 2018 12:21:14 -0400 (0:00:00.078) 0:07:34.699 ******* >2018-08-30 12:21:14,953 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:14,969 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:21:14,969 p=14044 u=mistral | Thursday 30 August 2018 12:21:14 -0400 (0:00:00.049) 0:07:34.748 ******* >2018-08-30 12:21:15,002 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:15,016 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:21:15,017 p=14044 u=mistral | Thursday 30 August 2018 12:21:15 -0400 (0:00:00.047) 0:07:34.796 ******* >2018-08-30 12:21:15,086 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:15,099 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:21:15,099 p=14044 u=mistral | Thursday 30 August 2018 12:21:15 -0400 (0:00:00.082) 0:07:34.879 ******* >2018-08-30 12:21:15,138 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:15,152 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:21:15,152 p=14044 u=mistral | Thursday 30 August 2018 12:21:15 -0400 (0:00:00.052) 0:07:34.931 ******* >2018-08-30 12:21:15,183 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:15,196 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:21:15,196 p=14044 u=mistral | Thursday 30 August 2018 12:21:15 -0400 (0:00:00.044) 0:07:34.975 ******* >2018-08-30 12:21:15,554 p=14044 u=mistral | changed: [172.16.0.36] => (item=/etc/ceph) >2018-08-30 12:21:15,834 p=14044 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:21:16,118 p=14044 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:21:16,437 p=14044 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:21:16,718 p=14044 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:21:16,734 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:21:16,734 p=14044 u=mistral | Thursday 30 August 2018 12:21:16 -0400 (0:00:01.537) 0:07:36.513 ******* >2018-08-30 12:21:16,771 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:16,789 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:21:16,790 p=14044 u=mistral | Thursday 30 August 2018 12:21:16 -0400 (0:00:00.055) 0:07:36.569 ******* >2018-08-30 12:21:16,823 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:16,844 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:21:16,844 p=14044 u=mistral | Thursday 30 August 2018 12:21:16 -0400 (0:00:00.054) 0:07:36.624 ******* >2018-08-30 12:21:16,890 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:16,911 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:21:16,911 p=14044 u=mistral | Thursday 30 August 2018 12:21:16 -0400 (0:00:00.066) 0:07:36.690 ******* >2018-08-30 12:21:16,941 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:16,959 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:21:16,960 p=14044 u=mistral | Thursday 30 August 2018 12:21:16 -0400 (0:00:00.048) 0:07:36.739 ******* >2018-08-30 12:21:16,988 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:17,002 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:21:17,002 p=14044 u=mistral | Thursday 30 August 2018 12:21:17 -0400 (0:00:00.042) 0:07:36.781 ******* >2018-08-30 12:21:17,317 p=14044 u=mistral | changed: [172.16.0.36] >2018-08-30 12:21:17,333 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:21:17,334 p=14044 u=mistral | Thursday 30 August 2018 12:21:17 -0400 (0:00:00.331) 0:07:37.113 ******* >2018-08-30 12:21:19,784 p=14044 u=mistral | changed: [172.16.0.36] >2018-08-30 12:21:19,794 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:21:19,794 p=14044 u=mistral | Thursday 30 August 2018 12:21:19 -0400 (0:00:02.460) 0:07:39.573 ******* >2018-08-30 12:21:19,833 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:19,845 p=14044 u=mistral | TASK [ceph-osd : make sure public_network configured] ************************** >2018-08-30 12:21:19,846 p=14044 u=mistral | Thursday 30 August 2018 12:21:19 -0400 (0:00:00.051) 0:07:39.625 ******* >2018-08-30 12:21:19,881 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:19,894 p=14044 u=mistral | TASK [ceph-osd : make sure cluster_network configured] ************************* >2018-08-30 12:21:19,894 p=14044 u=mistral | Thursday 30 August 2018 12:21:19 -0400 (0:00:00.048) 0:07:39.673 ******* >2018-08-30 12:21:19,932 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:19,943 p=14044 u=mistral | TASK [ceph-osd : make sure journal_size configured] **************************** >2018-08-30 12:21:19,944 p=14044 u=mistral | Thursday 30 August 2018 12:21:19 -0400 (0:00:00.049) 0:07:39.723 ******* >2018-08-30 12:21:19,969 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:19,982 p=14044 u=mistral | TASK [ceph-osd : make sure an osd scenario was chosen] ************************* >2018-08-30 12:21:19,983 p=14044 u=mistral | Thursday 30 August 2018 12:21:19 -0400 (0:00:00.039) 0:07:39.762 ******* >2018-08-30 12:21:20,018 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,033 p=14044 u=mistral | TASK [ceph-osd : make sure a valid osd scenario was chosen] ******************** >2018-08-30 12:21:20,034 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.050) 0:07:39.813 ******* >2018-08-30 12:21:20,071 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,084 p=14044 u=mistral | TASK [ceph-osd : verify devices have been provided] **************************** >2018-08-30 12:21:20,084 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.050) 0:07:39.863 ******* >2018-08-30 12:21:20,127 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,140 p=14044 u=mistral | TASK [ceph-osd : check if osd_scenario lvm is supported by the selected ceph version] *** >2018-08-30 12:21:20,140 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.056) 0:07:39.919 ******* >2018-08-30 12:21:20,177 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,195 p=14044 u=mistral | TASK [ceph-osd : verify lvm_volumes have been provided] ************************ >2018-08-30 12:21:20,195 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.055) 0:07:39.974 ******* >2018-08-30 12:21:20,235 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,253 p=14044 u=mistral | TASK [ceph-osd : make sure the lvm_volumes variable is a list] ***************** >2018-08-30 12:21:20,253 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.058) 0:07:40.032 ******* >2018-08-30 12:21:20,293 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,306 p=14044 u=mistral | TASK [ceph-osd : make sure the devices variable is a list] ********************* >2018-08-30 12:21:20,307 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.053) 0:07:40.086 ******* >2018-08-30 12:21:20,343 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,356 p=14044 u=mistral | TASK [ceph-osd : verify dedicated devices have been provided] ****************** >2018-08-30 12:21:20,356 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.049) 0:07:40.136 ******* >2018-08-30 12:21:20,391 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,403 p=14044 u=mistral | TASK [ceph-osd : make sure the dedicated_devices variable is a list] *********** >2018-08-30 12:21:20,404 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.046) 0:07:40.183 ******* >2018-08-30 12:21:20,438 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,455 p=14044 u=mistral | TASK [ceph-osd : check if bluestore is supported by the selected ceph version] *** >2018-08-30 12:21:20,455 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.051) 0:07:40.234 ******* >2018-08-30 12:21:20,488 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,506 p=14044 u=mistral | TASK [ceph-osd : include system_tuning.yml] ************************************ >2018-08-30 12:21:20,507 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.051) 0:07:40.286 ******* >2018-08-30 12:21:20,553 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/system_tuning.yml for 172.16.0.36 >2018-08-30 12:21:20,588 p=14044 u=mistral | TASK [ceph-osd : disable osd directory parsing by updatedb] ******************** >2018-08-30 12:21:20,588 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.081) 0:07:40.367 ******* >2018-08-30 12:21:20,612 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,624 p=14044 u=mistral | TASK [ceph-osd : disable osd directory path in updatedb.conf] ****************** >2018-08-30 12:21:20,624 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.036) 0:07:40.404 ******* >2018-08-30 12:21:20,651 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:20,663 p=14044 u=mistral | TASK [ceph-osd : create tmpfiles.d directory] ********************************** >2018-08-30 12:21:20,663 p=14044 u=mistral | Thursday 30 August 2018 12:21:20 -0400 (0:00:00.038) 0:07:40.442 ******* >2018-08-30 12:21:20,991 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:21,004 p=14044 u=mistral | TASK [ceph-osd : disable transparent hugepage] ********************************* >2018-08-30 12:21:21,004 p=14044 u=mistral | Thursday 30 August 2018 12:21:21 -0400 (0:00:00.341) 0:07:40.784 ******* >2018-08-30 12:21:21,746 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:21,758 p=14044 u=mistral | TASK [ceph-osd : get default vm.min_free_kbytes] ******************************* >2018-08-30 12:21:21,758 p=14044 u=mistral | Thursday 30 August 2018 12:21:21 -0400 (0:00:00.753) 0:07:41.537 ******* >2018-08-30 12:21:22,074 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:22,087 p=14044 u=mistral | TASK [ceph-osd : set_fact vm_min_free_kbytes] ********************************** >2018-08-30 12:21:22,088 p=14044 u=mistral | Thursday 30 August 2018 12:21:22 -0400 (0:00:00.329) 0:07:41.867 ******* >2018-08-30 12:21:22,160 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:22,176 p=14044 u=mistral | TASK [ceph-osd : apply operating system tuning] ******************************** >2018-08-30 12:21:22,177 p=14044 u=mistral | Thursday 30 August 2018 12:21:22 -0400 (0:00:00.089) 0:07:41.956 ******* >2018-08-30 12:21:22,521 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'enable': u"(osd_objectstore == 'bluestore')", u'name': u'fs.aio-max-nr', u'value': u'1048576'}) >2018-08-30 12:21:22,816 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'name': u'fs.file-max', u'value': 26234859}) >2018-08-30 12:21:23,120 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'name': u'vm.zone_reclaim_mode', u'value': 0}) >2018-08-30 12:21:23,417 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'name': u'vm.swappiness', u'value': 10}) >2018-08-30 12:21:23,886 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'name': u'vm.min_free_kbytes', u'value': u'67584'}) >2018-08-30 12:21:23,901 p=14044 u=mistral | TASK [ceph-osd : install dependencies] ***************************************** >2018-08-30 12:21:23,901 p=14044 u=mistral | Thursday 30 August 2018 12:21:23 -0400 (0:00:01.724) 0:07:43.680 ******* >2018-08-30 12:21:23,928 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:23,942 p=14044 u=mistral | TASK [ceph-osd : include common.yml] ******************************************* >2018-08-30 12:21:23,943 p=14044 u=mistral | Thursday 30 August 2018 12:21:23 -0400 (0:00:00.041) 0:07:43.722 ******* >2018-08-30 12:21:23,982 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/common.yml for 172.16.0.36 >2018-08-30 12:21:24,025 p=14044 u=mistral | TASK [ceph-osd : create bootstrap-osd and osd directories] ********************* >2018-08-30 12:21:24,026 p=14044 u=mistral | Thursday 30 August 2018 12:21:24 -0400 (0:00:00.082) 0:07:43.805 ******* >2018-08-30 12:21:24,358 p=14044 u=mistral | changed: [172.16.0.36] => (item=/var/lib/ceph/bootstrap-osd/) >2018-08-30 12:21:24,649 p=14044 u=mistral | ok: [172.16.0.36] => (item=/var/lib/ceph/osd/) >2018-08-30 12:21:24,664 p=14044 u=mistral | TASK [ceph-osd : copy ceph key(s) if needed] *********************************** >2018-08-30 12:21:24,664 p=14044 u=mistral | Thursday 30 August 2018 12:21:24 -0400 (0:00:00.638) 0:07:44.444 ******* >2018-08-30 12:21:25,420 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'name': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'copy_key': True}) >2018-08-30 12:21:25,428 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:21:25,443 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore'] *** >2018-08-30 12:21:25,443 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.779) 0:07:45.223 ******* >2018-08-30 12:21:25,471 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,484 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options 'ceph_disk_cli_options'] ******* >2018-08-30 12:21:25,484 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.040) 0:07:45.263 ******* >2018-08-30 12:21:25,524 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,539 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph'] ************** >2018-08-30 12:21:25,539 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.055) 0:07:45.319 ******* >2018-08-30 12:21:25,578 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,594 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore --dmcrypt'] *** >2018-08-30 12:21:25,594 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.054) 0:07:45.373 ******* >2018-08-30 12:21:25,623 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,639 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --filestore --dmcrypt'] *** >2018-08-30 12:21:25,640 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.045) 0:07:45.419 ******* >2018-08-30 12:21:25,671 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,686 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --dmcrypt'] **** >2018-08-30 12:21:25,687 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.046) 0:07:45.466 ******* >2018-08-30 12:21:25,720 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,737 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e KV_TYPE=etcd -e KV_IP=127.0.0.1 -e KV_PORT=2379'] *** >2018-08-30 12:21:25,738 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.050) 0:07:45.517 ******* >2018-08-30 12:21:25,769 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,785 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:21:25,786 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.047) 0:07:45.565 ******* >2018-08-30 12:21:25,856 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:25,868 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:21:25,869 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.083) 0:07:45.648 ******* >2018-08-30 12:21:25,901 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,914 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:21:25,915 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.045) 0:07:45.694 ******* >2018-08-30 12:21:25,949 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:25,963 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:21:25,963 p=14044 u=mistral | Thursday 30 August 2018 12:21:25 -0400 (0:00:00.048) 0:07:45.742 ******* >2018-08-30 12:21:25,995 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:26,009 p=14044 u=mistral | TASK [ceph-osd : set_fact devices generate device list when osd_auto_discovery] *** >2018-08-30 12:21:26,009 p=14044 u=mistral | Thursday 30 August 2018 12:21:26 -0400 (0:00:00.046) 0:07:45.789 ******* >2018-08-30 12:21:26,061 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vda1': {u'sectorsize': 512, u'uuid': u'2018-08-02-20-03-27-00', u'links': {u'masters': [], u'labels': [u'config-2'], u'ids': [], u'uuids': [u'2018-08-02-20-03-27-00']}, u'sectors': u'2048', u'start': u'2048', u'holders': [], u'size': u'1.00 MB'}, u'vda2': {u'sectorsize': 512, u'uuid': u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2', u'links': {u'masters': [], u'labels': [u'img-rootfs'], u'ids': [], u'uuids': [u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2']}, u'sectors': u'209711071', u'start': u'4096', u'holders': [], u'size': u'100.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vda'}) >2018-08-30 12:21:26,065 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vdb1': {u'sectorsize': 512, u'uuid': u'e325b6ba-99ca-49d9-90d0-e984779ee379', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': [u'e325b6ba-99ca-49d9-90d0-e984779ee379']}, u'sectors': u'199227359', u'start': u'10487808', u'holders': [], u'size': u'95.00 GB'}, u'vdb2': {u'sectorsize': 512, u'uuid': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'10485760', u'start': u'2048', u'holders': [], u'size': u'5.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vdb'}) >2018-08-30 12:21:26,086 p=14044 u=mistral | TASK [ceph-osd : resolve dedicated device link(s)] ***************************** >2018-08-30 12:21:26,086 p=14044 u=mistral | Thursday 30 August 2018 12:21:26 -0400 (0:00:00.076) 0:07:45.865 ******* >2018-08-30 12:21:26,127 p=14044 u=mistral | TASK [ceph-osd : set_fact build dedicated_devices from resolved symlinks] ****** >2018-08-30 12:21:26,128 p=14044 u=mistral | Thursday 30 August 2018 12:21:26 -0400 (0:00:00.041) 0:07:45.907 ******* >2018-08-30 12:21:26,166 p=14044 u=mistral | TASK [ceph-osd : set_fact build final dedicated_devices list] ****************** >2018-08-30 12:21:26,166 p=14044 u=mistral | Thursday 30 August 2018 12:21:26 -0400 (0:00:00.038) 0:07:45.945 ******* >2018-08-30 12:21:26,198 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:26,214 p=14044 u=mistral | TASK [ceph-osd : read information about the devices] *************************** >2018-08-30 12:21:26,215 p=14044 u=mistral | Thursday 30 August 2018 12:21:26 -0400 (0:00:00.048) 0:07:45.994 ******* >2018-08-30 12:21:26,603 p=14044 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:21:26,619 p=14044 u=mistral | TASK [ceph-osd : check the partition status of the osd disks] ****************** >2018-08-30 12:21:26,619 p=14044 u=mistral | Thursday 30 August 2018 12:21:26 -0400 (0:00:00.404) 0:07:46.398 ******* >2018-08-30 12:21:26,976 p=14044 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:21:26,991 p=14044 u=mistral | TASK [ceph-osd : create gpt disk label] **************************************** >2018-08-30 12:21:26,991 p=14044 u=mistral | Thursday 30 August 2018 12:21:26 -0400 (0:00:00.371) 0:07:46.770 ******* >2018-08-30 12:21:27,051 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'blkid', u'-t', u'PTTYPE=gpt', u'/dev/vdb'], u'end': u'2018-08-30 12:21:27.927648', '_ansible_no_log': False, u'stdout': u'/dev/vdb: PTTYPE="gpt" ', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.008599', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'blkid -t PTTYPE="gpt" /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb: PTTYPE="gpt" '], 'failed_when_result': False, u'start': u'2018-08-30 12:21:27.919049', '_ansible_ignore_errors': None, 'failed': False}, u'/dev/vdb']) >2018-08-30 12:21:27,069 p=14044 u=mistral | TASK [ceph-osd : include scenarios/collocated.yml] ***************************** >2018-08-30 12:21:27,069 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.077) 0:07:46.848 ******* >2018-08-30 12:21:27,113 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/scenarios/collocated.yml for 172.16.0.36 >2018-08-30 12:21:27,165 p=14044 u=mistral | TASK [ceph-osd : prepare ceph containerized osd disk collocated] *************** >2018-08-30 12:21:27,165 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.096) 0:07:46.945 ******* >2018-08-30 12:21:27,222 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:21:27,236 p=14044 u=mistral | TASK [ceph-osd : automatic prepare ceph containerized osd disk collocated] ***** >2018-08-30 12:21:27,236 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.071) 0:07:47.016 ******* >2018-08-30 12:21:27,267 p=14044 u=mistral | skipping: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:21:27,283 p=14044 u=mistral | TASK [ceph-osd : manually prepare ceph "filestore" non-containerized osd disk(s) with collocated osd data and journal] *** >2018-08-30 12:21:27,283 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.046) 0:07:47.062 ******* >2018-08-30 12:21:27,319 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:21:27,334 p=14044 u=mistral | TASK [ceph-osd : include scenarios/non-collocated.yml] ************************* >2018-08-30 12:21:27,334 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.051) 0:07:47.114 ******* >2018-08-30 12:21:27,363 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:27,375 p=14044 u=mistral | TASK [ceph-osd : include scenarios/lvm.yml] ************************************ >2018-08-30 12:21:27,376 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.041) 0:07:47.155 ******* >2018-08-30 12:21:27,401 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:27,415 p=14044 u=mistral | TASK [ceph-osd : include activate_osds.yml] ************************************ >2018-08-30 12:21:27,416 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.039) 0:07:47.195 ******* >2018-08-30 12:21:27,440 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:27,454 p=14044 u=mistral | TASK [ceph-osd : include start_osds.yml] *************************************** >2018-08-30 12:21:27,454 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.038) 0:07:47.234 ******* >2018-08-30 12:21:27,482 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:27,494 p=14044 u=mistral | TASK [ceph-osd : include docker/main.yml] ************************************** >2018-08-30 12:21:27,495 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.040) 0:07:47.274 ******* >2018-08-30 12:21:27,533 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/main.yml for 172.16.0.36 >2018-08-30 12:21:27,596 p=14044 u=mistral | TASK [ceph-osd : include start_docker_osd.yml] ********************************* >2018-08-30 12:21:27,596 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.101) 0:07:47.375 ******* >2018-08-30 12:21:27,640 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/start_docker_osd.yml for 172.16.0.36 >2018-08-30 12:21:27,656 p=14044 u=mistral | TASK [ceph-osd : umount ceph disk (if on openstack)] *************************** >2018-08-30 12:21:27,656 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.059) 0:07:47.435 ******* >2018-08-30 12:21:27,679 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:27,692 p=14044 u=mistral | TASK [ceph-osd : test if the container image has the disk_list function] ******* >2018-08-30 12:21:27,692 p=14044 u=mistral | Thursday 30 August 2018 12:21:27 -0400 (0:00:00.036) 0:07:47.471 ******* >2018-08-30 12:21:28,674 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:28,687 p=14044 u=mistral | TASK [ceph-osd : generate ceph osd docker run script] ************************** >2018-08-30 12:21:28,687 p=14044 u=mistral | Thursday 30 August 2018 12:21:28 -0400 (0:00:00.994) 0:07:48.466 ******* >2018-08-30 12:21:29,716 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:29,729 p=14044 u=mistral | TASK [ceph-osd : generate systemd unit file] *********************************** >2018-08-30 12:21:29,729 p=14044 u=mistral | Thursday 30 August 2018 12:21:29 -0400 (0:00:01.041) 0:07:49.508 ******* >2018-08-30 12:21:30,782 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:30,795 p=14044 u=mistral | TASK [ceph-osd : systemd start osd container] ********************************** >2018-08-30 12:21:30,796 p=14044 u=mistral | Thursday 30 August 2018 12:21:30 -0400 (0:00:01.066) 0:07:50.575 ******* >2018-08-30 12:21:31,509 p=14044 u=mistral | ok: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:21:31,526 p=14044 u=mistral | TASK [ceph-osd : set_fact openstack_keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:21:31,526 p=14044 u=mistral | Thursday 30 August 2018 12:21:31 -0400 (0:00:00.730) 0:07:51.306 ******* >2018-08-30 12:21:31,800 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:21:31,831 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:21:31,862 p=14044 u=mistral | ok: [172.16.0.36] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:21:31,876 p=14044 u=mistral | TASK [ceph-osd : set_fact keys - override keys_tmp with keys] ****************** >2018-08-30 12:21:31,876 p=14044 u=mistral | Thursday 30 August 2018 12:21:31 -0400 (0:00:00.350) 0:07:51.656 ******* >2018-08-30 12:21:32,125 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:32,152 p=14044 u=mistral | TASK [ceph-osd : wait for all osd to be up] ************************************ >2018-08-30 12:21:32,153 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.276) 0:07:51.932 ******* >2018-08-30 12:21:32,183 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:32,218 p=14044 u=mistral | TASK [ceph-osd : list existing pool(s)] **************************************** >2018-08-30 12:21:32,218 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.065) 0:07:51.997 ******* >2018-08-30 12:21:32,264 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,273 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,286 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,300 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,314 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,359 p=14044 u=mistral | TASK [ceph-osd : create openstack pool(s)] ************************************* >2018-08-30 12:21:32,359 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.140) 0:07:52.138 ******* >2018-08-30 12:21:32,403 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:21:32,415 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:21:32,426 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:21:32,438 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:21:32,449 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, {'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, 'changed': False, '_ansible_ignore_errors': None}]) >2018-08-30 12:21:32,497 p=14044 u=mistral | TASK [ceph-osd : assign application to pool(s)] ******************************** >2018-08-30 12:21:32,497 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.137) 0:07:52.276 ******* >2018-08-30 12:21:32,540 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,549 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,560 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,570 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,581 p=14044 u=mistral | skipping: [172.16.0.36] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:21:32,619 p=14044 u=mistral | TASK [ceph-osd : create openstack cephx key(s)] ******************************** >2018-08-30 12:21:32,619 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.122) 0:07:52.399 ******* >2018-08-30 12:21:32,658 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:21:32,669 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:21:32,680 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:21:32,712 p=14044 u=mistral | TASK [ceph-osd : fetch openstack cephx key(s)] ********************************* >2018-08-30 12:21:32,713 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.093) 0:07:52.492 ******* >2018-08-30 12:21:32,753 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:21:32,762 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:21:32,777 p=14044 u=mistral | skipping: [172.16.0.36] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:21:32,844 p=14044 u=mistral | TASK [ceph-osd : copy to other mons the openstack cephx key(s)] **************** >2018-08-30 12:21:32,844 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.131) 0:07:52.623 ******* >2018-08-30 12:21:32,886 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.33', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:21:32,895 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.33', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:21:32,909 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.33', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:21:32,919 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.24', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:21:32,930 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.24', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:21:32,948 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.24', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:21:32,959 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.25', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:21:32,975 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.25', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:21:32,992 p=14044 u=mistral | skipping: [172.16.0.36] => (item=[u'172.16.0.25', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:21:32,996 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:21:32,996 p=14044 u=mistral | Thursday 30 August 2018 12:21:32 -0400 (0:00:00.152) 0:07:52.776 ******* >2018-08-30 12:21:33,248 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:33,249 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:21:33,249 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.252) 0:07:53.028 ******* >2018-08-30 12:21:33,284 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:33,285 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:21:33,285 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.036) 0:07:53.064 ******* >2018-08-30 12:21:33,370 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.33) >2018-08-30 12:21:33,376 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.24) >2018-08-30 12:21:33,383 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.25) >2018-08-30 12:21:33,385 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:21:33,385 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.099) 0:07:53.164 ******* >2018-08-30 12:21:33,472 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.33) >2018-08-30 12:21:33,481 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.24) >2018-08-30 12:21:33,488 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.25) >2018-08-30 12:21:33,489 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:21:33,490 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.104) 0:07:53.269 ******* >2018-08-30 12:21:33,563 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:33,564 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:21:33,565 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.075) 0:07:53.344 ******* >2018-08-30 12:21:33,639 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:33,640 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:21:33,641 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.075) 0:07:53.420 ******* >2018-08-30 12:21:33,689 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:33,690 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:21:33,690 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.049) 0:07:53.470 ******* >2018-08-30 12:21:33,778 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.28) >2018-08-30 12:21:33,787 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:21:33,798 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.32) >2018-08-30 12:21:33,799 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:21:33,800 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.109) 0:07:53.579 ******* >2018-08-30 12:21:33,909 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.28) >2018-08-30 12:21:33,923 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.36) >2018-08-30 12:21:33,936 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.32) >2018-08-30 12:21:33,938 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:21:33,939 p=14044 u=mistral | Thursday 30 August 2018 12:21:33 -0400 (0:00:00.138) 0:07:53.718 ******* >2018-08-30 12:21:34,223 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:34,224 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:21:34,224 p=14044 u=mistral | Thursday 30 August 2018 12:21:34 -0400 (0:00:00.285) 0:07:54.003 ******* >2018-08-30 12:21:34,488 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:34,489 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:21:34,489 p=14044 u=mistral | Thursday 30 August 2018 12:21:34 -0400 (0:00:00.264) 0:07:54.268 ******* >2018-08-30 12:21:34,527 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:34,528 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:21:34,528 p=14044 u=mistral | Thursday 30 August 2018 12:21:34 -0400 (0:00:00.039) 0:07:54.307 ******* >2018-08-30 12:21:34,572 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:21:34,573 p=14044 u=mistral | Thursday 30 August 2018 12:21:34 -0400 (0:00:00.044) 0:07:54.352 ******* >2018-08-30 12:21:34,615 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:21:34,615 p=14044 u=mistral | Thursday 30 August 2018 12:21:34 -0400 (0:00:00.042) 0:07:54.394 ******* >2018-08-30 12:21:34,868 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:34,869 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:21:34,869 p=14044 u=mistral | Thursday 30 August 2018 12:21:34 -0400 (0:00:00.253) 0:07:54.648 ******* >2018-08-30 12:21:35,117 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:35,118 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:21:35,119 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.249) 0:07:54.898 ******* >2018-08-30 12:21:35,160 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:35,161 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:21:35,161 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.042) 0:07:54.940 ******* >2018-08-30 12:21:35,207 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:21:35,208 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.046) 0:07:54.987 ******* >2018-08-30 12:21:35,249 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:21:35,250 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.042) 0:07:55.029 ******* >2018-08-30 12:21:35,500 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:35,501 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:21:35,501 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.251) 0:07:55.280 ******* >2018-08-30 12:21:35,755 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:35,756 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:21:35,757 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.255) 0:07:55.536 ******* >2018-08-30 12:21:35,798 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:35,799 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:21:35,799 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.042) 0:07:55.578 ******* >2018-08-30 12:21:35,842 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:21:35,842 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.043) 0:07:55.622 ******* >2018-08-30 12:21:35,888 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:21:35,888 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.045) 0:07:55.667 ******* >2018-08-30 12:21:35,952 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:35,954 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:21:35,954 p=14044 u=mistral | Thursday 30 August 2018 12:21:35 -0400 (0:00:00.065) 0:07:55.733 ******* >2018-08-30 12:21:36,023 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:36,024 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:21:36,025 p=14044 u=mistral | Thursday 30 August 2018 12:21:36 -0400 (0:00:00.070) 0:07:55.804 ******* >2018-08-30 12:21:36,071 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:36,072 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:21:36,072 p=14044 u=mistral | Thursday 30 August 2018 12:21:36 -0400 (0:00:00.047) 0:07:55.851 ******* >2018-08-30 12:21:36,158 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.33) >2018-08-30 12:21:36,163 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.24) >2018-08-30 12:21:36,169 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.25) >2018-08-30 12:21:36,171 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:21:36,171 p=14044 u=mistral | Thursday 30 August 2018 12:21:36 -0400 (0:00:00.098) 0:07:55.950 ******* >2018-08-30 12:21:36,261 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.33) >2018-08-30 12:21:36,263 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.24) >2018-08-30 12:21:36,271 p=14044 u=mistral | skipping: [172.16.0.36] => (item=172.16.0.25) >2018-08-30 12:21:36,272 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:21:36,273 p=14044 u=mistral | Thursday 30 August 2018 12:21:36 -0400 (0:00:00.101) 0:07:56.052 ******* >2018-08-30 12:21:36,521 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:36,537 p=14044 u=mistral | TASK [get osd numbers] ********************************************************* >2018-08-30 12:21:36,538 p=14044 u=mistral | Thursday 30 August 2018 12:21:36 -0400 (0:00:00.265) 0:07:56.317 ******* >2018-08-30 12:21:36,567 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:36,586 p=14044 u=mistral | TASK [start ceph osd] ********************************************************** >2018-08-30 12:21:36,587 p=14044 u=mistral | Thursday 30 August 2018 12:21:36 -0400 (0:00:00.049) 0:07:56.366 ******* >2018-08-30 12:21:36,620 p=14044 u=mistral | skipping: [172.16.0.36] >2018-08-30 12:21:36,639 p=14044 u=mistral | TASK [restart containerized ceph osd] ****************************************** >2018-08-30 12:21:36,640 p=14044 u=mistral | Thursday 30 August 2018 12:21:36 -0400 (0:00:00.052) 0:07:56.419 ******* >2018-08-30 12:21:37,632 p=14044 u=mistral | changed: [172.16.0.36] => (item=/dev/vdb) >2018-08-30 12:21:37,656 p=14044 u=mistral | TASK [set_fact docker_exec_cmd_osd] ******************************************** >2018-08-30 12:21:37,656 p=14044 u=mistral | Thursday 30 August 2018 12:21:37 -0400 (0:00:01.016) 0:07:57.435 ******* >2018-08-30 12:21:37,923 p=14044 u=mistral | ok: [172.16.0.36] >2018-08-30 12:21:37,956 p=14044 u=mistral | TASK [get num_pgs - non container] ********************************************* >2018-08-30 12:21:37,956 p=14044 u=mistral | Thursday 30 August 2018 12:21:37 -0400 (0:00:00.299) 0:07:57.735 ******* >2018-08-30 12:21:39,084 p=14044 u=mistral | changed: [172.16.0.36 -> 172.16.0.33] >2018-08-30 12:21:39,110 p=14044 u=mistral | TASK [waiting for clean pgs...] ************************************************ >2018-08-30 12:21:39,111 p=14044 u=mistral | Thursday 30 August 2018 12:21:39 -0400 (0:00:01.154) 0:07:58.890 ******* >2018-08-30 12:21:40,148 p=14044 u=mistral | FAILED - RETRYING: waiting for clean pgs... (40 retries left). >2018-08-30 12:22:10,987 p=14044 u=mistral | changed: [172.16.0.36 -> 172.16.0.33] >2018-08-30 12:22:11,004 p=14044 u=mistral | PLAY [upgrade ceph osds cluster] *********************************************** >2018-08-30 12:22:11,279 p=14044 u=mistral | TASK [get osd numbers] ********************************************************* >2018-08-30 12:22:11,279 p=14044 u=mistral | Thursday 30 August 2018 12:22:11 -0400 (0:00:32.168) 0:08:31.058 ******* >2018-08-30 12:22:11,310 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:11,322 p=14044 u=mistral | TASK [stop ceph osd] *********************************************************** >2018-08-30 12:22:11,323 p=14044 u=mistral | Thursday 30 August 2018 12:22:11 -0400 (0:00:00.043) 0:08:31.102 ******* >2018-08-30 12:22:11,354 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:11,367 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:22:11,368 p=14044 u=mistral | Thursday 30 August 2018 12:22:11 -0400 (0:00:00.045) 0:08:31.147 ******* >2018-08-30 12:22:11,401 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:11,418 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:22:11,418 p=14044 u=mistral | Thursday 30 August 2018 12:22:11 -0400 (0:00:00.050) 0:08:31.197 ******* >2018-08-30 12:22:11,865 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:11,879 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:22:11,879 p=14044 u=mistral | Thursday 30 August 2018 12:22:11 -0400 (0:00:00.461) 0:08:31.659 ******* >2018-08-30 12:22:11,919 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:11,940 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:22:11,941 p=14044 u=mistral | Thursday 30 August 2018 12:22:11 -0400 (0:00:00.061) 0:08:31.720 ******* >2018-08-30 12:22:11,973 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:11,993 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:22:11,993 p=14044 u=mistral | Thursday 30 August 2018 12:22:11 -0400 (0:00:00.052) 0:08:31.772 ******* >2018-08-30 12:22:12,027 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,039 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:22:12,040 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.046) 0:08:31.819 ******* >2018-08-30 12:22:12,070 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,085 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:22:12,086 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.046) 0:08:31.865 ******* >2018-08-30 12:22:12,126 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,139 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:22:12,139 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.053) 0:08:31.918 ******* >2018-08-30 12:22:12,168 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,181 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:22:12,181 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.042) 0:08:31.960 ******* >2018-08-30 12:22:12,211 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,224 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:22:12,224 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.042) 0:08:32.003 ******* >2018-08-30 12:22:12,254 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,267 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:22:12,267 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.043) 0:08:32.046 ******* >2018-08-30 12:22:12,297 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,308 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:22:12,309 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.041) 0:08:32.088 ******* >2018-08-30 12:22:12,336 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,349 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:22:12,349 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.040) 0:08:32.128 ******* >2018-08-30 12:22:12,379 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,393 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:22:12,393 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.043) 0:08:32.172 ******* >2018-08-30 12:22:12,423 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,436 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:22:12,436 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.043) 0:08:32.215 ******* >2018-08-30 12:22:12,465 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,480 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:22:12,480 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.043) 0:08:32.259 ******* >2018-08-30 12:22:12,508 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,520 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:22:12,521 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.040) 0:08:32.300 ******* >2018-08-30 12:22:12,553 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,567 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:22:12,567 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.046) 0:08:32.346 ******* >2018-08-30 12:22:12,602 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,616 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:22:12,616 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.049) 0:08:32.395 ******* >2018-08-30 12:22:12,652 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,669 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:22:12,669 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.053) 0:08:32.448 ******* >2018-08-30 12:22:12,696 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,710 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:22:12,710 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.040) 0:08:32.489 ******* >2018-08-30 12:22:12,738 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,752 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:22:12,752 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.042) 0:08:32.532 ******* >2018-08-30 12:22:12,782 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,795 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:22:12,796 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.043) 0:08:32.575 ******* >2018-08-30 12:22:12,823 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,836 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:22:12,836 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.040) 0:08:32.616 ******* >2018-08-30 12:22:12,866 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,879 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:22:12,879 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.042) 0:08:32.658 ******* >2018-08-30 12:22:12,905 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,919 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:22:12,919 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.040) 0:08:32.699 ******* >2018-08-30 12:22:12,947 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:12,961 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:22:12,961 p=14044 u=mistral | Thursday 30 August 2018 12:22:12 -0400 (0:00:00.041) 0:08:32.740 ******* >2018-08-30 12:22:12,990 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:13,004 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:22:13,005 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.043) 0:08:32.784 ******* >2018-08-30 12:22:13,039 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:13,052 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:22:13,052 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.047) 0:08:32.831 ******* >2018-08-30 12:22:13,376 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:13,390 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:22:13,390 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.337) 0:08:33.169 ******* >2018-08-30 12:22:13,448 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:13,461 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:22:13,461 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.071) 0:08:33.240 ******* >2018-08-30 12:22:13,527 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:13,540 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:22:13,540 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.079) 0:08:33.319 ******* >2018-08-30 12:22:13,562 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:13,588 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:22:13,588 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.048) 0:08:33.368 ******* >2018-08-30 12:22:13,694 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:22:13,718 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:22:13,719 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.130) 0:08:33.498 ******* >2018-08-30 12:22:13,749 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:13,770 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:22:13,771 p=14044 u=mistral | Thursday 30 August 2018 12:22:13 -0400 (0:00:00.052) 0:08:33.550 ******* >2018-08-30 12:22:13,991 p=14044 u=mistral | ok: [172.16.0.32 -> localhost] >2018-08-30 12:22:14,004 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:22:14,004 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.233) 0:08:33.784 ******* >2018-08-30 12:22:14,073 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:14,095 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:22:14,095 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.090) 0:08:33.874 ******* >2018-08-30 12:22:14,330 p=14044 u=mistral | ok: [172.16.0.32 -> localhost] >2018-08-30 12:22:14,346 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:22:14,347 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.251) 0:08:34.126 ******* >2018-08-30 12:22:14,376 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:14,389 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:22:14,389 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.042) 0:08:34.168 ******* >2018-08-30 12:22:14,453 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:14,471 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:22:14,472 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.082) 0:08:34.251 ******* >2018-08-30 12:22:14,495 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:14,515 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:22:14,515 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.043) 0:08:34.294 ******* >2018-08-30 12:22:14,542 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:14,567 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:22:14,567 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.051) 0:08:34.346 ******* >2018-08-30 12:22:14,589 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:14,601 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:22:14,602 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.034) 0:08:34.381 ******* >2018-08-30 12:22:14,625 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:14,639 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:22:14,639 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.037) 0:08:34.419 ******* >2018-08-30 12:22:14,704 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:14,715 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:22:14,716 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.076) 0:08:34.495 ******* >2018-08-30 12:22:14,736 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:14,747 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:22:14,748 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.032) 0:08:34.527 ******* >2018-08-30 12:22:14,810 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:14,823 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:22:14,823 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.075) 0:08:34.602 ******* >2018-08-30 12:22:14,894 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:14,905 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:22:14,906 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.082) 0:08:34.685 ******* >2018-08-30 12:22:14,972 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:14,986 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:22:14,986 p=14044 u=mistral | Thursday 30 August 2018 12:22:14 -0400 (0:00:00.080) 0:08:34.765 ******* >2018-08-30 12:22:15,329 p=14044 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:22:15,344 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:22:15,344 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.357) 0:08:35.123 ******* >2018-08-30 12:22:15,430 p=14044 u=mistral | ok: [172.16.0.32] => (item={'_ansible_parsed': True, 'stderr_lines': [], '_ansible_item_result': True, u'end': u'2018-08-30 12:22:16.281129', '_ansible_no_log': False, u'stdout': u'/dev/vdb', u'cmd': [u'readlink', u'-f', u'/dev/vdb'], u'rc': 0, 'item': u'/dev/vdb', u'delta': u'0:00:00.005283', u'stderr': u'', u'changed': False, u'invocation': {u'module_args': {u'creates': None, u'executable': None, u'_uses_shell': False, u'_raw_params': u'readlink -f /dev/vdb', u'removes': None, u'warn': True, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb'], u'start': u'2018-08-30 12:22:16.275846', '_ansible_ignore_errors': None, 'failed': False}) >2018-08-30 12:22:15,458 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:22:15,458 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.113) 0:08:35.237 ******* >2018-08-30 12:22:15,539 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:15,551 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:22:15,551 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.092) 0:08:35.330 ******* >2018-08-30 12:22:15,581 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:15,594 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:22:15,594 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.043) 0:08:35.373 ******* >2018-08-30 12:22:15,625 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:15,638 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:22:15,638 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.043) 0:08:35.417 ******* >2018-08-30 12:22:15,668 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:15,682 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:22:15,682 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.044) 0:08:35.462 ******* >2018-08-30 12:22:15,710 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:15,721 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:22:15,722 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.039) 0:08:35.501 ******* >2018-08-30 12:22:15,785 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:15,798 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:22:15,798 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.076) 0:08:35.577 ******* >2018-08-30 12:22:15,856 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:15,870 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:22:15,870 p=14044 u=mistral | Thursday 30 August 2018 12:22:15 -0400 (0:00:00.071) 0:08:35.649 ******* >2018-08-30 12:22:16,226 p=14044 u=mistral | changed: [172.16.0.32] => (item=/etc/ceph) >2018-08-30 12:22:16,510 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/) >2018-08-30 12:22:16,802 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/mon) >2018-08-30 12:22:17,108 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/osd) >2018-08-30 12:22:17,391 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/mds) >2018-08-30 12:22:17,669 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/tmp) >2018-08-30 12:22:17,952 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:22:18,438 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:22:18,714 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:22:18,985 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:22:19,278 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:22:19,570 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/run/ceph) >2018-08-30 12:22:19,593 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:22:19,593 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:03.723) 0:08:39.372 ******* >2018-08-30 12:22:19,623 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,636 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:22:19,637 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.043) 0:08:39.416 ******* >2018-08-30 12:22:19,665 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,678 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:22:19,678 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.041) 0:08:39.457 ******* >2018-08-30 12:22:19,710 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,724 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:22:19,724 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.045) 0:08:39.503 ******* >2018-08-30 12:22:19,753 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,767 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:22:19,767 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.043) 0:08:39.546 ******* >2018-08-30 12:22:19,796 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,810 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:22:19,810 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.042) 0:08:39.589 ******* >2018-08-30 12:22:19,839 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,854 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:22:19,855 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.044) 0:08:39.634 ******* >2018-08-30 12:22:19,885 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,899 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:22:19,899 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.044) 0:08:39.678 ******* >2018-08-30 12:22:19,925 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,940 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:22:19,941 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.041) 0:08:39.720 ******* >2018-08-30 12:22:19,969 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:19,983 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:22:19,983 p=14044 u=mistral | Thursday 30 August 2018 12:22:19 -0400 (0:00:00.042) 0:08:39.763 ******* >2018-08-30 12:22:20,010 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,023 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:22:20,023 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.039) 0:08:39.802 ******* >2018-08-30 12:22:20,049 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,062 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:22:20,062 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.038) 0:08:39.841 ******* >2018-08-30 12:22:20,090 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,104 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:22:20,104 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.042) 0:08:39.883 ******* >2018-08-30 12:22:20,135 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,149 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:22:20,149 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.044) 0:08:39.928 ******* >2018-08-30 12:22:20,181 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,194 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:22:20,195 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.045) 0:08:39.974 ******* >2018-08-30 12:22:20,229 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,242 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:22:20,242 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.047) 0:08:40.022 ******* >2018-08-30 12:22:20,277 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,290 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:22:20,290 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.048) 0:08:40.070 ******* >2018-08-30 12:22:20,317 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,330 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:22:20,330 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.039) 0:08:40.109 ******* >2018-08-30 12:22:20,356 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,368 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:22:20,369 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.038) 0:08:40.148 ******* >2018-08-30 12:22:20,395 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,409 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:22:20,409 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.040) 0:08:40.188 ******* >2018-08-30 12:22:20,438 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,450 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:22:20,450 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.041) 0:08:40.230 ******* >2018-08-30 12:22:20,479 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,490 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:22:20,491 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.040) 0:08:40.270 ******* >2018-08-30 12:22:20,518 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,530 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:22:20,531 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.039) 0:08:40.310 ******* >2018-08-30 12:22:20,562 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,574 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:22:20,575 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.043) 0:08:40.354 ******* >2018-08-30 12:22:20,604 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,617 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:22:20,617 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.042) 0:08:40.396 ******* >2018-08-30 12:22:20,649 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,661 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:22:20,662 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.044) 0:08:40.441 ******* >2018-08-30 12:22:20,689 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,701 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:22:20,702 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.039) 0:08:40.481 ******* >2018-08-30 12:22:20,733 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,749 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-ceph01/keyring already exists] *** >2018-08-30 12:22:20,749 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.047) 0:08:40.528 ******* >2018-08-30 12:22:20,785 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,811 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-ceph01/keyring doesn't exist] *** >2018-08-30 12:22:20,811 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.061) 0:08:40.590 ******* >2018-08-30 12:22:20,844 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,857 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:22:20,857 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.045) 0:08:40.636 ******* >2018-08-30 12:22:20,882 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,894 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:22:20,895 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.037) 0:08:40.674 ******* >2018-08-30 12:22:20,923 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,935 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:22:20,935 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.040) 0:08:40.714 ******* >2018-08-30 12:22:20,962 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:20,984 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:22:20,984 p=14044 u=mistral | Thursday 30 August 2018 12:22:20 -0400 (0:00:00.048) 0:08:40.763 ******* >2018-08-30 12:22:21,011 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,023 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:22:21,024 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.039) 0:08:40.803 ******* >2018-08-30 12:22:21,049 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,061 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:22:21,062 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.038) 0:08:40.841 ******* >2018-08-30 12:22:21,100 p=14044 u=mistral | skipping: [172.16.0.32] => (item=/var/run/ceph) >2018-08-30 12:22:21,108 p=14044 u=mistral | skipping: [172.16.0.32] => (item=/var/log/ceph) >2018-08-30 12:22:21,122 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:22:21,122 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.060) 0:08:40.902 ******* >2018-08-30 12:22:21,151 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,164 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:22:21,164 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.041) 0:08:40.943 ******* >2018-08-30 12:22:21,191 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,202 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:22:21,203 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.038) 0:08:40.982 ******* >2018-08-30 12:22:21,229 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,243 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:22:21,243 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.040) 0:08:41.022 ******* >2018-08-30 12:22:21,275 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,287 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:22:21,288 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.044) 0:08:41.067 ******* >2018-08-30 12:22:21,316 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,328 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:22:21,328 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.040) 0:08:41.108 ******* >2018-08-30 12:22:21,365 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,377 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:22:21,377 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.048) 0:08:41.157 ******* >2018-08-30 12:22:21,405 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,417 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:22:21,418 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.040) 0:08:41.197 ******* >2018-08-30 12:22:21,447 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,460 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:22:21,460 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.042) 0:08:41.239 ******* >2018-08-30 12:22:21,491 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:21,505 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:22:21,505 p=14044 u=mistral | Thursday 30 August 2018 12:22:21 -0400 (0:00:00.045) 0:08:41.285 ******* >2018-08-30 12:22:21,863 p=14044 u=mistral | ok: [172.16.0.32] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:22:22,153 p=14044 u=mistral | ok: [172.16.0.32] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:22:22,168 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:22:22,168 p=14044 u=mistral | Thursday 30 August 2018 12:22:22 -0400 (0:00:00.662) 0:08:41.948 ******* >2018-08-30 12:22:22,234 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:22,248 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:22:22,249 p=14044 u=mistral | Thursday 30 August 2018 12:22:22 -0400 (0:00:00.080) 0:08:42.028 ******* >2018-08-30 12:22:22,274 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:22,286 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:22:22,286 p=14044 u=mistral | Thursday 30 August 2018 12:22:22 -0400 (0:00:00.037) 0:08:42.065 ******* >2018-08-30 12:22:22,639 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:22,652 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:22:22,652 p=14044 u=mistral | Thursday 30 August 2018 12:22:22 -0400 (0:00:00.366) 0:08:42.431 ******* >2018-08-30 12:22:22,724 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:22,736 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:22:22,736 p=14044 u=mistral | Thursday 30 August 2018 12:22:22 -0400 (0:00:00.083) 0:08:42.515 ******* >2018-08-30 12:22:23,065 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:23,084 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:22:23,084 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.347) 0:08:42.863 ******* >2018-08-30 12:22:23,127 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,147 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:22:23,148 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.063) 0:08:42.927 ******* >2018-08-30 12:22:23,199 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.33) >2018-08-30 12:22:23,220 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.24) >2018-08-30 12:22:23,243 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.25) >2018-08-30 12:22:23,256 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:22:23,257 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.108) 0:08:43.036 ******* >2018-08-30 12:22:23,296 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,311 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:22:23,311 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.054) 0:08:43.090 ******* >2018-08-30 12:22:23,351 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,372 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:22:23,372 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.061) 0:08:43.151 ******* >2018-08-30 12:22:23,418 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:22:23,418 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.045) 0:08:43.197 ******* >2018-08-30 12:22:23,456 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:22:23,456 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.038) 0:08:43.235 ******* >2018-08-30 12:22:23,485 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,498 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:22:23,498 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.041) 0:08:43.277 ******* >2018-08-30 12:22:23,527 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,542 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:22:23,542 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.044) 0:08:43.322 ******* >2018-08-30 12:22:23,577 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,591 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:22:23,591 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.048) 0:08:43.370 ******* >2018-08-30 12:22:23,626 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,640 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:22:23,640 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.049) 0:08:43.419 ******* >2018-08-30 12:22:23,674 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,687 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:22:23,688 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.047) 0:08:43.467 ******* >2018-08-30 12:22:23,721 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,736 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:22:23,736 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.047) 0:08:43.515 ******* >2018-08-30 12:22:23,764 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,778 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:22:23,778 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.042) 0:08:43.558 ******* >2018-08-30 12:22:23,810 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,823 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:22:23,823 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.044) 0:08:43.602 ******* >2018-08-30 12:22:23,856 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:23,869 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:22:23,869 p=14044 u=mistral | Thursday 30 August 2018 12:22:23 -0400 (0:00:00.045) 0:08:43.648 ******* >2018-08-30 12:22:24,278 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:24,301 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:22:24,301 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.431) 0:08:44.080 ******* >2018-08-30 12:22:24,329 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:24,342 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:22:24,343 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.041) 0:08:44.122 ******* >2018-08-30 12:22:24,372 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:24,387 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:22:24,387 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.044) 0:08:44.166 ******* >2018-08-30 12:22:24,420 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:24,434 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:22:24,435 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.047) 0:08:44.214 ******* >2018-08-30 12:22:24,466 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:24,481 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:22:24,481 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.046) 0:08:44.260 ******* >2018-08-30 12:22:24,510 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:24,524 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:22:24,525 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.043) 0:08:44.304 ******* >2018-08-30 12:22:24,555 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:24,569 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:22:24,569 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.044) 0:08:44.349 ******* >2018-08-30 12:22:24,955 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:24,972 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:22:24,973 p=14044 u=mistral | Thursday 30 August 2018 12:22:24 -0400 (0:00:00.403) 0:08:44.752 ******* >2018-08-30 12:22:25,002 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,017 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:22:25,017 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.044) 0:08:44.796 ******* >2018-08-30 12:22:25,047 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,069 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:22:25,069 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.052) 0:08:44.849 ******* >2018-08-30 12:22:25,103 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,116 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:22:25,116 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.046) 0:08:44.895 ******* >2018-08-30 12:22:25,147 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,167 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:22:25,168 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.051) 0:08:44.947 ******* >2018-08-30 12:22:25,201 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,217 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:22:25,218 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.050) 0:08:44.997 ******* >2018-08-30 12:22:25,258 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,272 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:22:25,272 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.054) 0:08:45.051 ******* >2018-08-30 12:22:25,345 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:25,364 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:22:25,364 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.092) 0:08:45.143 ******* >2018-08-30 12:22:25,393 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,406 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:22:25,406 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.041) 0:08:45.185 ******* >2018-08-30 12:22:25,440 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,456 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:22:25,457 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.050) 0:08:45.236 ******* >2018-08-30 12:22:25,490 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,503 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:22:25,503 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.045) 0:08:45.282 ******* >2018-08-30 12:22:25,533 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,546 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:22:25,546 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.043) 0:08:45.326 ******* >2018-08-30 12:22:25,578 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:25,593 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:22:25,593 p=14044 u=mistral | Thursday 30 August 2018 12:22:25 -0400 (0:00:00.046) 0:08:45.372 ******* >2018-08-30 12:22:26,026 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:26,050 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:22:26,050 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.456) 0:08:45.829 ******* >2018-08-30 12:22:26,429 p=14044 u=mistral | changed: [172.16.0.32] >2018-08-30 12:22:26,447 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:22:26,448 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.397) 0:08:46.227 ******* >2018-08-30 12:22:26,523 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:26,536 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:22:26,537 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.089) 0:08:46.316 ******* >2018-08-30 12:22:26,573 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,586 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:22:26,586 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.049) 0:08:46.365 ******* >2018-08-30 12:22:26,629 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,641 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:22:26,642 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.055) 0:08:46.421 ******* >2018-08-30 12:22:26,669 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,689 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:22:26,689 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.047) 0:08:46.469 ******* >2018-08-30 12:22:26,724 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,741 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:22:26,741 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.051) 0:08:46.521 ******* >2018-08-30 12:22:26,780 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,794 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:22:26,794 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.052) 0:08:46.573 ******* >2018-08-30 12:22:26,823 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,838 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:22:26,838 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.044) 0:08:46.617 ******* >2018-08-30 12:22:26,866 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,891 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:22:26,891 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.053) 0:08:46.670 ******* >2018-08-30 12:22:26,924 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,937 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:22:26,937 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.045) 0:08:46.716 ******* >2018-08-30 12:22:26,968 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:26,980 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:22:26,980 p=14044 u=mistral | Thursday 30 August 2018 12:22:26 -0400 (0:00:00.043) 0:08:46.759 ******* >2018-08-30 12:22:27,014 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:27,028 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:22:27,028 p=14044 u=mistral | Thursday 30 August 2018 12:22:27 -0400 (0:00:00.047) 0:08:46.807 ******* >2018-08-30 12:22:27,055 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:27,068 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:22:27,069 p=14044 u=mistral | Thursday 30 August 2018 12:22:27 -0400 (0:00:00.040) 0:08:46.848 ******* >2018-08-30 12:22:28,057 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:28,072 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:22:28,072 p=14044 u=mistral | Thursday 30 August 2018 12:22:28 -0400 (0:00:01.003) 0:08:47.851 ******* >2018-08-30 12:22:28,135 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:28,150 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:22:28,150 p=14044 u=mistral | Thursday 30 August 2018 12:22:28 -0400 (0:00:00.077) 0:08:47.929 ******* >2018-08-30 12:22:28,185 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:28,199 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:22:28,199 p=14044 u=mistral | Thursday 30 August 2018 12:22:28 -0400 (0:00:00.049) 0:08:47.978 ******* >2018-08-30 12:22:28,230 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:28,243 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:22:28,243 p=14044 u=mistral | Thursday 30 August 2018 12:22:28 -0400 (0:00:00.044) 0:08:48.022 ******* >2018-08-30 12:22:28,308 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:28,321 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:22:28,321 p=14044 u=mistral | Thursday 30 August 2018 12:22:28 -0400 (0:00:00.078) 0:08:48.101 ******* >2018-08-30 12:22:28,352 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:28,365 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:22:28,366 p=14044 u=mistral | Thursday 30 August 2018 12:22:28 -0400 (0:00:00.044) 0:08:48.145 ******* >2018-08-30 12:22:28,397 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:28,411 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:22:28,412 p=14044 u=mistral | Thursday 30 August 2018 12:22:28 -0400 (0:00:00.045) 0:08:48.191 ******* >2018-08-30 12:22:28,744 p=14044 u=mistral | changed: [172.16.0.32] => (item=/etc/ceph) >2018-08-30 12:22:29,052 p=14044 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:22:29,357 p=14044 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:22:29,812 p=14044 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:22:30,131 p=14044 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:22:30,146 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:22:30,147 p=14044 u=mistral | Thursday 30 August 2018 12:22:30 -0400 (0:00:01.734) 0:08:49.926 ******* >2018-08-30 12:22:30,174 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:30,190 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:22:30,190 p=14044 u=mistral | Thursday 30 August 2018 12:22:30 -0400 (0:00:00.043) 0:08:49.970 ******* >2018-08-30 12:22:30,219 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:30,238 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:22:30,238 p=14044 u=mistral | Thursday 30 August 2018 12:22:30 -0400 (0:00:00.047) 0:08:50.017 ******* >2018-08-30 12:22:30,281 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:30,301 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:22:30,302 p=14044 u=mistral | Thursday 30 August 2018 12:22:30 -0400 (0:00:00.063) 0:08:50.081 ******* >2018-08-30 12:22:30,333 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:30,353 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:22:30,353 p=14044 u=mistral | Thursday 30 August 2018 12:22:30 -0400 (0:00:00.051) 0:08:50.133 ******* >2018-08-30 12:22:30,386 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:30,398 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:22:30,399 p=14044 u=mistral | Thursday 30 August 2018 12:22:30 -0400 (0:00:00.045) 0:08:50.178 ******* >2018-08-30 12:22:30,719 p=14044 u=mistral | changed: [172.16.0.32] >2018-08-30 12:22:30,734 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:22:30,734 p=14044 u=mistral | Thursday 30 August 2018 12:22:30 -0400 (0:00:00.335) 0:08:50.513 ******* >2018-08-30 12:22:33,372 p=14044 u=mistral | changed: [172.16.0.32] >2018-08-30 12:22:33,382 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:22:33,383 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:02.648) 0:08:53.162 ******* >2018-08-30 12:22:33,416 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,429 p=14044 u=mistral | TASK [ceph-osd : make sure public_network configured] ************************** >2018-08-30 12:22:33,429 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.046) 0:08:53.208 ******* >2018-08-30 12:22:33,464 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,478 p=14044 u=mistral | TASK [ceph-osd : make sure cluster_network configured] ************************* >2018-08-30 12:22:33,478 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.049) 0:08:53.258 ******* >2018-08-30 12:22:33,511 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,524 p=14044 u=mistral | TASK [ceph-osd : make sure journal_size configured] **************************** >2018-08-30 12:22:33,524 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.045) 0:08:53.303 ******* >2018-08-30 12:22:33,552 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,565 p=14044 u=mistral | TASK [ceph-osd : make sure an osd scenario was chosen] ************************* >2018-08-30 12:22:33,565 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.041) 0:08:53.345 ******* >2018-08-30 12:22:33,602 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,615 p=14044 u=mistral | TASK [ceph-osd : make sure a valid osd scenario was chosen] ******************** >2018-08-30 12:22:33,615 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.049) 0:08:53.394 ******* >2018-08-30 12:22:33,656 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,670 p=14044 u=mistral | TASK [ceph-osd : verify devices have been provided] **************************** >2018-08-30 12:22:33,670 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.054) 0:08:53.449 ******* >2018-08-30 12:22:33,713 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,727 p=14044 u=mistral | TASK [ceph-osd : check if osd_scenario lvm is supported by the selected ceph version] *** >2018-08-30 12:22:33,727 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.057) 0:08:53.506 ******* >2018-08-30 12:22:33,763 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,776 p=14044 u=mistral | TASK [ceph-osd : verify lvm_volumes have been provided] ************************ >2018-08-30 12:22:33,776 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.049) 0:08:53.556 ******* >2018-08-30 12:22:33,814 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,831 p=14044 u=mistral | TASK [ceph-osd : make sure the lvm_volumes variable is a list] ***************** >2018-08-30 12:22:33,832 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.055) 0:08:53.611 ******* >2018-08-30 12:22:33,872 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,895 p=14044 u=mistral | TASK [ceph-osd : make sure the devices variable is a list] ********************* >2018-08-30 12:22:33,896 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.063) 0:08:53.675 ******* >2018-08-30 12:22:33,936 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:33,952 p=14044 u=mistral | TASK [ceph-osd : verify dedicated devices have been provided] ****************** >2018-08-30 12:22:33,952 p=14044 u=mistral | Thursday 30 August 2018 12:22:33 -0400 (0:00:00.056) 0:08:53.731 ******* >2018-08-30 12:22:33,995 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:34,012 p=14044 u=mistral | TASK [ceph-osd : make sure the dedicated_devices variable is a list] *********** >2018-08-30 12:22:34,013 p=14044 u=mistral | Thursday 30 August 2018 12:22:34 -0400 (0:00:00.060) 0:08:53.792 ******* >2018-08-30 12:22:34,055 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:34,069 p=14044 u=mistral | TASK [ceph-osd : check if bluestore is supported by the selected ceph version] *** >2018-08-30 12:22:34,069 p=14044 u=mistral | Thursday 30 August 2018 12:22:34 -0400 (0:00:00.056) 0:08:53.849 ******* >2018-08-30 12:22:34,107 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:34,120 p=14044 u=mistral | TASK [ceph-osd : include system_tuning.yml] ************************************ >2018-08-30 12:22:34,121 p=14044 u=mistral | Thursday 30 August 2018 12:22:34 -0400 (0:00:00.051) 0:08:53.900 ******* >2018-08-30 12:22:34,161 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/system_tuning.yml for 172.16.0.32 >2018-08-30 12:22:34,199 p=14044 u=mistral | TASK [ceph-osd : disable osd directory parsing by updatedb] ******************** >2018-08-30 12:22:34,200 p=14044 u=mistral | Thursday 30 August 2018 12:22:34 -0400 (0:00:00.078) 0:08:53.979 ******* >2018-08-30 12:22:34,226 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:34,238 p=14044 u=mistral | TASK [ceph-osd : disable osd directory path in updatedb.conf] ****************** >2018-08-30 12:22:34,239 p=14044 u=mistral | Thursday 30 August 2018 12:22:34 -0400 (0:00:00.038) 0:08:54.018 ******* >2018-08-30 12:22:34,264 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:34,283 p=14044 u=mistral | TASK [ceph-osd : create tmpfiles.d directory] ********************************** >2018-08-30 12:22:34,283 p=14044 u=mistral | Thursday 30 August 2018 12:22:34 -0400 (0:00:00.044) 0:08:54.063 ******* >2018-08-30 12:22:34,598 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:34,611 p=14044 u=mistral | TASK [ceph-osd : disable transparent hugepage] ********************************* >2018-08-30 12:22:34,612 p=14044 u=mistral | Thursday 30 August 2018 12:22:34 -0400 (0:00:00.328) 0:08:54.391 ******* >2018-08-30 12:22:35,312 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:35,325 p=14044 u=mistral | TASK [ceph-osd : get default vm.min_free_kbytes] ******************************* >2018-08-30 12:22:35,325 p=14044 u=mistral | Thursday 30 August 2018 12:22:35 -0400 (0:00:00.713) 0:08:55.104 ******* >2018-08-30 12:22:35,646 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:35,660 p=14044 u=mistral | TASK [ceph-osd : set_fact vm_min_free_kbytes] ********************************** >2018-08-30 12:22:35,660 p=14044 u=mistral | Thursday 30 August 2018 12:22:35 -0400 (0:00:00.335) 0:08:55.439 ******* >2018-08-30 12:22:35,719 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:35,735 p=14044 u=mistral | TASK [ceph-osd : apply operating system tuning] ******************************** >2018-08-30 12:22:35,735 p=14044 u=mistral | Thursday 30 August 2018 12:22:35 -0400 (0:00:00.075) 0:08:55.515 ******* >2018-08-30 12:22:36,073 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'enable': u"(osd_objectstore == 'bluestore')", u'name': u'fs.aio-max-nr', u'value': u'1048576'}) >2018-08-30 12:22:36,369 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'name': u'fs.file-max', u'value': 26234859}) >2018-08-30 12:22:36,837 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'name': u'vm.zone_reclaim_mode', u'value': 0}) >2018-08-30 12:22:37,132 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'name': u'vm.swappiness', u'value': 10}) >2018-08-30 12:22:37,434 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'name': u'vm.min_free_kbytes', u'value': u'67584'}) >2018-08-30 12:22:37,449 p=14044 u=mistral | TASK [ceph-osd : install dependencies] ***************************************** >2018-08-30 12:22:37,449 p=14044 u=mistral | Thursday 30 August 2018 12:22:37 -0400 (0:00:01.713) 0:08:57.228 ******* >2018-08-30 12:22:37,475 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:37,489 p=14044 u=mistral | TASK [ceph-osd : include common.yml] ******************************************* >2018-08-30 12:22:37,489 p=14044 u=mistral | Thursday 30 August 2018 12:22:37 -0400 (0:00:00.040) 0:08:57.268 ******* >2018-08-30 12:22:37,529 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/common.yml for 172.16.0.32 >2018-08-30 12:22:37,574 p=14044 u=mistral | TASK [ceph-osd : create bootstrap-osd and osd directories] ********************* >2018-08-30 12:22:37,574 p=14044 u=mistral | Thursday 30 August 2018 12:22:37 -0400 (0:00:00.085) 0:08:57.353 ******* >2018-08-30 12:22:37,884 p=14044 u=mistral | changed: [172.16.0.32] => (item=/var/lib/ceph/bootstrap-osd/) >2018-08-30 12:22:38,150 p=14044 u=mistral | ok: [172.16.0.32] => (item=/var/lib/ceph/osd/) >2018-08-30 12:22:38,168 p=14044 u=mistral | TASK [ceph-osd : copy ceph key(s) if needed] *********************************** >2018-08-30 12:22:38,169 p=14044 u=mistral | Thursday 30 August 2018 12:22:38 -0400 (0:00:00.594) 0:08:57.948 ******* >2018-08-30 12:22:38,866 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'name': u'/var/lib/ceph/bootstrap-osd/ceph.keyring', u'copy_key': True}) >2018-08-30 12:22:38,874 p=14044 u=mistral | skipping: [172.16.0.32] => (item={u'name': u'/etc/ceph/ceph.client.admin.keyring', u'copy_key': False}) >2018-08-30 12:22:38,890 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore'] *** >2018-08-30 12:22:38,890 p=14044 u=mistral | Thursday 30 August 2018 12:22:38 -0400 (0:00:00.721) 0:08:58.669 ******* >2018-08-30 12:22:38,922 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:38,935 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options 'ceph_disk_cli_options'] ******* >2018-08-30 12:22:38,935 p=14044 u=mistral | Thursday 30 August 2018 12:22:38 -0400 (0:00:00.045) 0:08:58.714 ******* >2018-08-30 12:22:38,985 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,001 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph'] ************** >2018-08-30 12:22:39,001 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.066) 0:08:58.780 ******* >2018-08-30 12:22:39,045 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,058 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --bluestore --dmcrypt'] *** >2018-08-30 12:22:39,059 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.057) 0:08:58.838 ******* >2018-08-30 12:22:39,087 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,103 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --filestore --dmcrypt'] *** >2018-08-30 12:22:39,103 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.044) 0:08:58.882 ******* >2018-08-30 12:22:39,136 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,151 p=14044 u=mistral | TASK [ceph-osd : set_fact ceph_disk_cli_options '--cluster ceph --dmcrypt'] **** >2018-08-30 12:22:39,152 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.048) 0:08:58.931 ******* >2018-08-30 12:22:39,185 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,201 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e KV_TYPE=etcd -e KV_IP=127.0.0.1 -e KV_PORT=2379'] *** >2018-08-30 12:22:39,201 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.049) 0:08:58.980 ******* >2018-08-30 12:22:39,228 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,241 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:22:39,241 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.040) 0:08:59.020 ******* >2018-08-30 12:22:39,304 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:39,317 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=0 -e OSD_FILESTORE=1 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:22:39,317 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.076) 0:08:59.097 ******* >2018-08-30 12:22:39,350 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,365 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=0'] *** >2018-08-30 12:22:39,366 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.048) 0:08:59.145 ******* >2018-08-30 12:22:39,395 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,410 p=14044 u=mistral | TASK [ceph-osd : set_fact docker_env_args '-e OSD_BLUESTORE=1 -e OSD_FILESTORE=0 -e OSD_DMCRYPT=1'] *** >2018-08-30 12:22:39,410 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.044) 0:08:59.189 ******* >2018-08-30 12:22:39,442 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,457 p=14044 u=mistral | TASK [ceph-osd : set_fact devices generate device list when osd_auto_discovery] *** >2018-08-30 12:22:39,458 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.047) 0:08:59.237 ******* >2018-08-30 12:22:39,506 p=14044 u=mistral | skipping: [172.16.0.32] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vda1': {u'sectorsize': 512, u'uuid': u'2018-08-02-20-03-09-00', u'links': {u'masters': [], u'labels': [u'config-2'], u'ids': [], u'uuids': [u'2018-08-02-20-03-09-00']}, u'sectors': u'2048', u'start': u'2048', u'holders': [], u'size': u'1.00 MB'}, u'vda2': {u'sectorsize': 512, u'uuid': u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2', u'links': {u'masters': [], u'labels': [u'img-rootfs'], u'ids': [], u'uuids': [u'c9efa9ba-cbb7-4fc9-b576-1f67555300d2']}, u'sectors': u'209711071', u'start': u'4096', u'holders': [], u'size': u'100.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vda'}) >2018-08-30 12:22:39,511 p=14044 u=mistral | skipping: [172.16.0.32] => (item={'value': {u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'vendor': u'0x1af4', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'209715200', u'sas_device_handle': None, u'sas_address': None, u'virtual': 1, u'host': u'SCSI storage controller: Red Hat, Inc. Virtio block device', u'sectorsize': u'512', u'removable': u'0', u'support_discard': u'0', u'model': None, u'partitions': {u'vdb1': {u'sectorsize': 512, u'uuid': u'eb7deb9b-da77-44ba-bdc0-97c895020896', u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': [u'eb7deb9b-da77-44ba-bdc0-97c895020896']}, u'sectors': u'199227359', u'start': u'10487808', u'holders': [], u'size': u'95.00 GB'}, u'vdb2': {u'sectorsize': 512, u'uuid': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sectors': u'10485760', u'start': u'2048', u'holders': [], u'size': u'5.00 GB'}}, u'holders': [], u'size': u'100.00 GB'}, 'key': u'vdb'}) >2018-08-30 12:22:39,534 p=14044 u=mistral | TASK [ceph-osd : resolve dedicated device link(s)] ***************************** >2018-08-30 12:22:39,535 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.077) 0:08:59.314 ******* >2018-08-30 12:22:39,582 p=14044 u=mistral | TASK [ceph-osd : set_fact build dedicated_devices from resolved symlinks] ****** >2018-08-30 12:22:39,583 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.047) 0:08:59.362 ******* >2018-08-30 12:22:39,628 p=14044 u=mistral | TASK [ceph-osd : set_fact build final dedicated_devices list] ****************** >2018-08-30 12:22:39,628 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.045) 0:08:59.408 ******* >2018-08-30 12:22:39,658 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:39,675 p=14044 u=mistral | TASK [ceph-osd : read information about the devices] *************************** >2018-08-30 12:22:39,675 p=14044 u=mistral | Thursday 30 August 2018 12:22:39 -0400 (0:00:00.046) 0:08:59.454 ******* >2018-08-30 12:22:40,063 p=14044 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:22:40,079 p=14044 u=mistral | TASK [ceph-osd : check the partition status of the osd disks] ****************** >2018-08-30 12:22:40,079 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.403) 0:08:59.858 ******* >2018-08-30 12:22:40,418 p=14044 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:22:40,433 p=14044 u=mistral | TASK [ceph-osd : create gpt disk label] **************************************** >2018-08-30 12:22:40,434 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.354) 0:09:00.213 ******* >2018-08-30 12:22:40,480 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'blkid', u'-t', u'PTTYPE=gpt', u'/dev/vdb'], u'end': u'2018-08-30 12:22:41.370834', '_ansible_no_log': False, u'stdout': u'/dev/vdb: PTTYPE="gpt" ', '_ansible_item_result': True, u'changed': False, 'item': u'/dev/vdb', u'delta': u'0:00:00.006985', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'blkid -t PTTYPE="gpt" /dev/vdb', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'/dev/vdb: PTTYPE="gpt" '], 'failed_when_result': False, u'start': u'2018-08-30 12:22:41.363849', '_ansible_ignore_errors': None, 'failed': False}, u'/dev/vdb']) >2018-08-30 12:22:40,499 p=14044 u=mistral | TASK [ceph-osd : include scenarios/collocated.yml] ***************************** >2018-08-30 12:22:40,499 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.065) 0:09:00.278 ******* >2018-08-30 12:22:40,553 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/scenarios/collocated.yml for 172.16.0.32 >2018-08-30 12:22:40,604 p=14044 u=mistral | TASK [ceph-osd : prepare ceph containerized osd disk collocated] *************** >2018-08-30 12:22:40,604 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.105) 0:09:00.384 ******* >2018-08-30 12:22:40,649 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:22:40,665 p=14044 u=mistral | TASK [ceph-osd : automatic prepare ceph containerized osd disk collocated] ***** >2018-08-30 12:22:40,665 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.060) 0:09:00.445 ******* >2018-08-30 12:22:40,695 p=14044 u=mistral | skipping: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:22:40,709 p=14044 u=mistral | TASK [ceph-osd : manually prepare ceph "filestore" non-containerized osd disk(s) with collocated osd data and journal] *** >2018-08-30 12:22:40,710 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.044) 0:09:00.489 ******* >2018-08-30 12:22:40,748 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{'_ansible_parsed': True, u'changed': False, '_ansible_no_log': False, u'script': u"unit 'MiB' print", '_ansible_item_result': True, 'failed': False, 'item': u'/dev/vdb', u'invocation': {u'module_args': {u'part_start': u'0%', u'part_end': u'100%', u'name': None, u'align': u'optimal', u'number': None, u'label': u'msdos', u'state': u'info', u'part_type': u'primary', u'flags': None, u'device': u'/dev/vdb', u'unit': u'MiB'}}, u'disk': {u'dev': u'/dev/vdb', u'physical_block': 512, u'table': u'gpt', u'logical_block': 512, u'model': u'Virtio Block Device', u'unit': u'mib', u'size': 102400.0}, '_ansible_ignore_errors': None, u'partitions': [{u'begin': 1.0, u'end': 5121.0, u'name': u'ceph journal', u'fstype': u'', u'num': 2, u'flags': [], u'unit': u'mib', u'size': 5120.0}, {u'begin': 5121.0, u'end': 102400.0, u'name': u'ceph data', u'fstype': u'xfs', u'num': 1, u'flags': [], u'unit': u'mib', u'size': 97279.0}]}, u'/dev/vdb']) >2018-08-30 12:22:40,762 p=14044 u=mistral | TASK [ceph-osd : include scenarios/non-collocated.yml] ************************* >2018-08-30 12:22:40,762 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.052) 0:09:00.541 ******* >2018-08-30 12:22:40,792 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:40,804 p=14044 u=mistral | TASK [ceph-osd : include scenarios/lvm.yml] ************************************ >2018-08-30 12:22:40,805 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.042) 0:09:00.584 ******* >2018-08-30 12:22:40,831 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:40,843 p=14044 u=mistral | TASK [ceph-osd : include activate_osds.yml] ************************************ >2018-08-30 12:22:40,843 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.038) 0:09:00.623 ******* >2018-08-30 12:22:40,871 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:40,883 p=14044 u=mistral | TASK [ceph-osd : include start_osds.yml] *************************************** >2018-08-30 12:22:40,883 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.039) 0:09:00.662 ******* >2018-08-30 12:22:40,909 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:40,922 p=14044 u=mistral | TASK [ceph-osd : include docker/main.yml] ************************************** >2018-08-30 12:22:40,922 p=14044 u=mistral | Thursday 30 August 2018 12:22:40 -0400 (0:00:00.039) 0:09:00.702 ******* >2018-08-30 12:22:40,966 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/main.yml for 172.16.0.32 >2018-08-30 12:22:41,028 p=14044 u=mistral | TASK [ceph-osd : include start_docker_osd.yml] ********************************* >2018-08-30 12:22:41,028 p=14044 u=mistral | Thursday 30 August 2018 12:22:41 -0400 (0:00:00.105) 0:09:00.808 ******* >2018-08-30 12:22:41,072 p=14044 u=mistral | included: /usr/share/ceph-ansible/roles/ceph-osd/tasks/docker/start_docker_osd.yml for 172.16.0.32 >2018-08-30 12:22:41,086 p=14044 u=mistral | TASK [ceph-osd : umount ceph disk (if on openstack)] *************************** >2018-08-30 12:22:41,086 p=14044 u=mistral | Thursday 30 August 2018 12:22:41 -0400 (0:00:00.057) 0:09:00.866 ******* >2018-08-30 12:22:41,111 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:22:41,126 p=14044 u=mistral | TASK [ceph-osd : test if the container image has the disk_list function] ******* >2018-08-30 12:22:41,126 p=14044 u=mistral | Thursday 30 August 2018 12:22:41 -0400 (0:00:00.039) 0:09:00.905 ******* >2018-08-30 12:22:42,056 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:42,071 p=14044 u=mistral | TASK [ceph-osd : generate ceph osd docker run script] ************************** >2018-08-30 12:22:42,071 p=14044 u=mistral | Thursday 30 August 2018 12:22:42 -0400 (0:00:00.945) 0:09:01.850 ******* >2018-08-30 12:22:43,015 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:43,029 p=14044 u=mistral | TASK [ceph-osd : generate systemd unit file] *********************************** >2018-08-30 12:22:43,029 p=14044 u=mistral | Thursday 30 August 2018 12:22:43 -0400 (0:00:00.958) 0:09:02.809 ******* >2018-08-30 12:22:43,912 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:43,926 p=14044 u=mistral | TASK [ceph-osd : systemd start osd container] ********************************** >2018-08-30 12:22:43,926 p=14044 u=mistral | Thursday 30 August 2018 12:22:43 -0400 (0:00:00.896) 0:09:03.705 ******* >2018-08-30 12:22:44,467 p=14044 u=mistral | ok: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:22:44,484 p=14044 u=mistral | TASK [ceph-osd : set_fact openstack_keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:22:44,484 p=14044 u=mistral | Thursday 30 August 2018 12:22:44 -0400 (0:00:00.558) 0:09:04.263 ******* >2018-08-30 12:22:44,562 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:22:44,590 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:22:44,619 p=14044 u=mistral | ok: [172.16.0.32] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:22:44,644 p=14044 u=mistral | TASK [ceph-osd : set_fact keys - override keys_tmp with keys] ****************** >2018-08-30 12:22:44,644 p=14044 u=mistral | Thursday 30 August 2018 12:22:44 -0400 (0:00:00.159) 0:09:04.423 ******* >2018-08-30 12:22:44,710 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:22:44,749 p=14044 u=mistral | TASK [ceph-osd : wait for all osd to be up] ************************************ >2018-08-30 12:22:44,749 p=14044 u=mistral | Thursday 30 August 2018 12:22:44 -0400 (0:00:00.105) 0:09:04.528 ******* >2018-08-30 12:22:46,252 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:22:46,289 p=14044 u=mistral | TASK [ceph-osd : list existing pool(s)] **************************************** >2018-08-30 12:22:46,290 p=14044 u=mistral | Thursday 30 August 2018 12:22:46 -0400 (0:00:01.540) 0:09:06.069 ******* >2018-08-30 12:22:47,191 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:48,038 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:48,873 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:49,742 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:50,577 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:50,631 p=14044 u=mistral | TASK [ceph-osd : create openstack pool(s)] ************************************* >2018-08-30 12:22:50,632 p=14044 u=mistral | Thursday 30 August 2018 12:22:50 -0400 (0:00:04.342) 0:09:10.411 ******* >2018-08-30 12:22:50,710 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'images', u'size'], u'end': u'2018-08-30 12:22:48.138757', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.520818', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get images size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:22:47.617939', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:22:50,740 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'metrics', u'size'], u'end': u'2018-08-30 12:22:48.987534', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.521482', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get metrics size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:22:48.466052', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:22:50,774 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'backups', u'size'], u'end': u'2018-08-30 12:22:49.824954', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.500420', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get backups size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:22:49.324534', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:22:50,808 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'vms', u'size'], u'end': u'2018-08-30 12:22:50.693281', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.534706', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get vms size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:22:50.158575', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:22:50,838 p=14044 u=mistral | skipping: [172.16.0.32] => (item=[{u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, {'_ansible_parsed': True, 'stderr_lines': [], u'cmd': [u'docker', u'exec', u'ceph-mon-lab-controller03', u'ceph', u'--cluster', u'ceph', u'osd', u'pool', u'get', u'volumes', u'size'], u'end': u'2018-08-30 12:22:51.527388', '_ansible_no_log': False, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_item_result': True, u'changed': True, u'stdout': u'size: 3', 'item': {u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}, u'delta': u'0:00:00.517260', u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'_raw_params': u'docker exec ceph-mon-lab-controller03 ceph --cluster ceph osd pool get volumes size', u'removes': None, u'creates': None, u'chdir': None, u'stdin': None}}, 'stdout_lines': [u'size: 3'], 'failed_when_result': False, u'start': u'2018-08-30 12:22:51.010128', '_ansible_ignore_errors': None, 'failed': False}]) >2018-08-30 12:22:50,881 p=14044 u=mistral | TASK [ceph-osd : assign application to pool(s)] ******************************** >2018-08-30 12:22:50,882 p=14044 u=mistral | Thursday 30 August 2018 12:22:50 -0400 (0:00:00.249) 0:09:10.661 ******* >2018-08-30 12:22:52,378 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'images', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:53,426 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'openstack_gnocchi', u'pg_num': 128, u'name': u'metrics', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:54,524 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'backups', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:55,465 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'vms', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:56,477 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={u'application': u'rbd', u'pg_num': 128, u'name': u'volumes', u'rule_name': u'replicated_rule'}) >2018-08-30 12:22:56,524 p=14044 u=mistral | TASK [ceph-osd : create openstack cephx key(s)] ******************************** >2018-08-30 12:22:56,525 p=14044 u=mistral | Thursday 30 August 2018 12:22:56 -0400 (0:00:05.642) 0:09:16.304 ******* >2018-08-30 12:22:58,534 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:23:00,197 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:23:06,999 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:23:07,040 p=14044 u=mistral | TASK [ceph-osd : fetch openstack cephx key(s)] ********************************* >2018-08-30 12:23:07,041 p=14044 u=mistral | Thursday 30 August 2018 12:23:07 -0400 (0:00:10.515) 0:09:26.820 ******* >2018-08-30 12:23:07,428 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mon': u'profile rbd', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:23:07,740 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', 'mgr': u'allow *'}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:23:08,061 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item={'caps': {'mds': u'', 'osd': u'allow rwx', 'mon': u'allow rw', 'mgr': u'allow *'}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:23:08,134 p=14044 u=mistral | TASK [ceph-osd : copy to other mons the openstack cephx key(s)] **************** >2018-08-30 12:23:08,135 p=14044 u=mistral | Thursday 30 August 2018 12:23:08 -0400 (0:00:01.093) 0:09:27.914 ******* >2018-08-30 12:23:08,877 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item=[u'172.16.0.33', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:23:09,616 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item=[u'172.16.0.33', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:23:10,355 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.33] => (item=[u'172.16.0.33', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:23:11,104 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.24] => (item=[u'172.16.0.24', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:23:11,794 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.24] => (item=[u'172.16.0.24', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:23:12,457 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.24] => (item=[u'172.16.0.24', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:23:13,230 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.25] => (item=[u'172.16.0.25', {'name': u'client.openstack', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u'', 'osd': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics', 'mgr': u'allow *', 'mon': u'profile rbd'}}]) >2018-08-30 12:23:13,943 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.25] => (item=[u'172.16.0.25', {'mode': u'0600', 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u'allow *', 'osd': u'allow rw', 'mgr': u'allow *', 'mon': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"'}}]) >2018-08-30 12:23:14,849 p=14044 u=mistral | ok: [172.16.0.32 -> 172.16.0.25] => (item=[u'172.16.0.25', {'name': u'client.radosgw', 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u'', 'osd': u'allow rwx', 'mgr': u'allow *', 'mon': u'allow rw'}}]) >2018-08-30 12:23:14,857 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:23:14,857 p=14044 u=mistral | Thursday 30 August 2018 12:23:14 -0400 (0:00:06.722) 0:09:34.637 ******* >2018-08-30 12:23:14,920 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:14,921 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:23:14,922 p=14044 u=mistral | Thursday 30 August 2018 12:23:14 -0400 (0:00:00.064) 0:09:34.701 ******* >2018-08-30 12:23:14,957 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:14,958 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:23:14,958 p=14044 u=mistral | Thursday 30 August 2018 12:23:14 -0400 (0:00:00.036) 0:09:34.738 ******* >2018-08-30 12:23:15,040 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.33) >2018-08-30 12:23:15,046 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.24) >2018-08-30 12:23:15,051 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.25) >2018-08-30 12:23:15,053 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:23:15,053 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.094) 0:09:34.832 ******* >2018-08-30 12:23:15,137 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.33) >2018-08-30 12:23:15,144 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.24) >2018-08-30 12:23:15,152 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.25) >2018-08-30 12:23:15,153 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:23:15,153 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.100) 0:09:34.933 ******* >2018-08-30 12:23:15,216 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:15,217 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:23:15,217 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.063) 0:09:34.996 ******* >2018-08-30 12:23:15,277 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:15,278 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:23:15,278 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.060) 0:09:35.057 ******* >2018-08-30 12:23:15,326 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:15,327 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:23:15,327 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.049) 0:09:35.106 ******* >2018-08-30 12:23:15,412 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.28) >2018-08-30 12:23:15,419 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.36) >2018-08-30 12:23:15,435 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:23:15,437 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:23:15,437 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.110) 0:09:35.216 ******* >2018-08-30 12:23:15,523 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.28) >2018-08-30 12:23:15,536 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.36) >2018-08-30 12:23:15,543 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.32) >2018-08-30 12:23:15,544 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:23:15,544 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.107) 0:09:35.323 ******* >2018-08-30 12:23:15,617 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:15,618 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:23:15,618 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.074) 0:09:35.398 ******* >2018-08-30 12:23:15,682 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:15,684 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:23:15,684 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.065) 0:09:35.463 ******* >2018-08-30 12:23:15,728 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:15,729 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:23:15,729 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.045) 0:09:35.508 ******* >2018-08-30 12:23:15,774 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:23:15,774 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.044) 0:09:35.553 ******* >2018-08-30 12:23:15,819 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:23:15,819 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.044) 0:09:35.598 ******* >2018-08-30 12:23:15,878 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:15,879 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:23:15,879 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.059) 0:09:35.658 ******* >2018-08-30 12:23:15,939 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:15,940 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:23:15,941 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.061) 0:09:35.720 ******* >2018-08-30 12:23:15,976 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:15,977 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:23:15,977 p=14044 u=mistral | Thursday 30 August 2018 12:23:15 -0400 (0:00:00.036) 0:09:35.756 ******* >2018-08-30 12:23:16,015 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:23:16,016 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.038) 0:09:35.795 ******* >2018-08-30 12:23:16,054 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:23:16,055 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.038) 0:09:35.834 ******* >2018-08-30 12:23:16,114 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:16,115 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:23:16,115 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.060) 0:09:35.894 ******* >2018-08-30 12:23:16,172 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:16,173 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:23:16,174 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.058) 0:09:35.953 ******* >2018-08-30 12:23:16,209 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:16,209 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:23:16,210 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.035) 0:09:35.989 ******* >2018-08-30 12:23:16,250 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:23:16,250 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.040) 0:09:36.029 ******* >2018-08-30 12:23:16,287 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:23:16,287 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.036) 0:09:36.066 ******* >2018-08-30 12:23:16,343 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:16,344 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:23:16,345 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.057) 0:09:36.124 ******* >2018-08-30 12:23:16,403 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:16,404 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:23:16,404 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.059) 0:09:36.183 ******* >2018-08-30 12:23:16,444 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:16,445 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:23:16,445 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.041) 0:09:36.225 ******* >2018-08-30 12:23:16,525 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.33) >2018-08-30 12:23:16,529 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.24) >2018-08-30 12:23:16,536 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.25) >2018-08-30 12:23:16,537 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:23:16,537 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.091) 0:09:36.317 ******* >2018-08-30 12:23:16,615 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.33) >2018-08-30 12:23:16,623 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.24) >2018-08-30 12:23:16,629 p=14044 u=mistral | skipping: [172.16.0.32] => (item=172.16.0.25) >2018-08-30 12:23:16,630 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:23:16,630 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.092) 0:09:36.409 ******* >2018-08-30 12:23:16,689 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:16,701 p=14044 u=mistral | TASK [get osd numbers] ********************************************************* >2018-08-30 12:23:16,701 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.071) 0:09:36.480 ******* >2018-08-30 12:23:16,727 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:16,744 p=14044 u=mistral | TASK [start ceph osd] ********************************************************** >2018-08-30 12:23:16,745 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.043) 0:09:36.524 ******* >2018-08-30 12:23:16,775 p=14044 u=mistral | skipping: [172.16.0.32] >2018-08-30 12:23:16,787 p=14044 u=mistral | TASK [restart containerized ceph osd] ****************************************** >2018-08-30 12:23:16,788 p=14044 u=mistral | Thursday 30 August 2018 12:23:16 -0400 (0:00:00.043) 0:09:36.567 ******* >2018-08-30 12:23:17,577 p=14044 u=mistral | changed: [172.16.0.32] => (item=/dev/vdb) >2018-08-30 12:23:17,600 p=14044 u=mistral | TASK [set_fact docker_exec_cmd_osd] ******************************************** >2018-08-30 12:23:17,601 p=14044 u=mistral | Thursday 30 August 2018 12:23:17 -0400 (0:00:00.813) 0:09:37.380 ******* >2018-08-30 12:23:17,697 p=14044 u=mistral | ok: [172.16.0.32] >2018-08-30 12:23:17,727 p=14044 u=mistral | TASK [get num_pgs - non container] ********************************************* >2018-08-30 12:23:17,727 p=14044 u=mistral | Thursday 30 August 2018 12:23:17 -0400 (0:00:00.126) 0:09:37.506 ******* >2018-08-30 12:23:18,690 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:23:18,718 p=14044 u=mistral | TASK [waiting for clean pgs...] ************************************************ >2018-08-30 12:23:18,718 p=14044 u=mistral | Thursday 30 August 2018 12:23:18 -0400 (0:00:00.991) 0:09:38.498 ******* >2018-08-30 12:23:19,566 p=14044 u=mistral | FAILED - RETRYING: waiting for clean pgs... (40 retries left). >2018-08-30 12:23:50,358 p=14044 u=mistral | changed: [172.16.0.32 -> 172.16.0.33] >2018-08-30 12:23:50,377 p=14044 u=mistral | PLAY [unset osd flags] ********************************************************* >2018-08-30 12:23:50,424 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:23:50,424 p=14044 u=mistral | Thursday 30 August 2018 12:23:50 -0400 (0:00:31.705) 0:10:10.204 ******* >2018-08-30 12:23:50,810 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:50,850 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:50,896 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:50,914 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:23:50,915 p=14044 u=mistral | Thursday 30 August 2018 12:23:50 -0400 (0:00:00.490) 0:10:10.694 ******* >2018-08-30 12:23:50,960 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:50,984 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:51,005 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:51,022 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:23:51,022 p=14044 u=mistral | Thursday 30 August 2018 12:23:51 -0400 (0:00:00.107) 0:10:10.801 ******* >2018-08-30 12:23:51,092 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:51,093 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:51,114 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:51,129 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:23:51,129 p=14044 u=mistral | Thursday 30 August 2018 12:23:51 -0400 (0:00:00.106) 0:10:10.908 ******* >2018-08-30 12:23:51,193 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:51,195 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:51,211 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:51,228 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:23:51,229 p=14044 u=mistral | Thursday 30 August 2018 12:23:51 -0400 (0:00:00.099) 0:10:11.008 ******* >2018-08-30 12:23:51,646 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:51,666 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:51,680 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:51,694 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:23:51,695 p=14044 u=mistral | Thursday 30 August 2018 12:23:51 -0400 (0:00:00.465) 0:10:11.474 ******* >2018-08-30 12:23:51,745 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:51,747 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:51,768 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:51,782 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:23:51,782 p=14044 u=mistral | Thursday 30 August 2018 12:23:51 -0400 (0:00:00.087) 0:10:11.562 ******* >2018-08-30 12:23:51,841 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:51,842 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:51,860 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:51,875 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:23:51,875 p=14044 u=mistral | Thursday 30 August 2018 12:23:51 -0400 (0:00:00.092) 0:10:11.654 ******* >2018-08-30 12:23:51,931 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:51,933 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:51,951 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:51,970 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:23:51,970 p=14044 u=mistral | Thursday 30 August 2018 12:23:51 -0400 (0:00:00.095) 0:10:11.749 ******* >2018-08-30 12:23:52,032 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,034 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,061 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,081 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:23:52,081 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.111) 0:10:11.861 ******* >2018-08-30 12:23:52,124 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,147 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,168 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,183 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:23:52,183 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.101) 0:10:11.963 ******* >2018-08-30 12:23:52,239 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,240 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,260 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,274 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:23:52,275 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.091) 0:10:12.054 ******* >2018-08-30 12:23:52,337 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,338 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,353 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,368 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:23:52,368 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.093) 0:10:12.147 ******* >2018-08-30 12:23:52,424 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,426 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,449 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,465 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:23:52,465 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.097) 0:10:12.244 ******* >2018-08-30 12:23:52,522 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,524 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,539 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,553 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:23:52,554 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.088) 0:10:12.333 ******* >2018-08-30 12:23:52,584 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,611 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,630 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,646 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:23:52,646 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.092) 0:10:12.425 ******* >2018-08-30 12:23:52,711 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,714 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,736 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,750 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:23:52,750 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.104) 0:10:12.529 ******* >2018-08-30 12:23:52,804 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,806 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,828 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,842 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:23:52,842 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.092) 0:10:12.621 ******* >2018-08-30 12:23:52,893 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:52,896 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:52,916 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:52,933 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:23:52,933 p=14044 u=mistral | Thursday 30 August 2018 12:23:52 -0400 (0:00:00.090) 0:10:12.712 ******* >2018-08-30 12:23:52,980 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,006 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,024 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,043 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:23:53,043 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.110) 0:10:12.822 ******* >2018-08-30 12:23:53,108 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,110 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,132 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,147 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:23:53,147 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.104) 0:10:12.926 ******* >2018-08-30 12:23:53,205 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,206 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,229 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,244 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:23:53,244 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.096) 0:10:13.023 ******* >2018-08-30 12:23:53,298 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,299 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,325 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,339 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:23:53,339 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.094) 0:10:13.118 ******* >2018-08-30 12:23:53,388 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,391 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,413 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,425 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:23:53,425 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.085) 0:10:13.204 ******* >2018-08-30 12:23:53,477 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,479 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,498 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,512 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:23:53,513 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.087) 0:10:13.292 ******* >2018-08-30 12:23:53,565 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,568 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,591 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,607 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:23:53,607 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.094) 0:10:13.386 ******* >2018-08-30 12:23:53,662 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,664 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,679 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,693 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:23:53,693 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.086) 0:10:13.473 ******* >2018-08-30 12:23:53,748 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,750 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,772 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,787 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:23:53,787 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.093) 0:10:13.566 ******* >2018-08-30 12:23:53,845 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:53,847 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:53,865 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:53,880 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:23:53,880 p=14044 u=mistral | Thursday 30 August 2018 12:23:53 -0400 (0:00:00.093) 0:10:13.659 ******* >2018-08-30 12:23:54,202 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:54,246 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:54,262 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:54,276 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:23:54,277 p=14044 u=mistral | Thursday 30 August 2018 12:23:54 -0400 (0:00:00.396) 0:10:14.056 ******* >2018-08-30 12:23:54,340 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:54,355 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:54,388 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:54,402 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:23:54,403 p=14044 u=mistral | Thursday 30 August 2018 12:23:54 -0400 (0:00:00.125) 0:10:14.182 ******* >2018-08-30 12:23:54,460 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:54,490 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:54,517 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:54,531 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:23:54,531 p=14044 u=mistral | Thursday 30 August 2018 12:23:54 -0400 (0:00:00.128) 0:10:14.310 ******* >2018-08-30 12:23:54,559 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:54,582 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:54,595 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:54,621 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:23:54,622 p=14044 u=mistral | Thursday 30 August 2018 12:23:54 -0400 (0:00:00.090) 0:10:14.401 ******* >2018-08-30 12:23:54,718 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:23:54,764 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:23:54,801 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:23:54,831 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:23:54,831 p=14044 u=mistral | Thursday 30 August 2018 12:23:54 -0400 (0:00:00.209) 0:10:14.610 ******* >2018-08-30 12:23:54,864 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:54,892 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:23:54,892 p=14044 u=mistral | Thursday 30 August 2018 12:23:54 -0400 (0:00:00.061) 0:10:14.671 ******* >2018-08-30 12:23:55,161 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:23:55,175 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:23:55,175 p=14044 u=mistral | Thursday 30 August 2018 12:23:55 -0400 (0:00:00.283) 0:10:14.955 ******* >2018-08-30 12:23:55,235 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:55,252 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:55,287 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:55,310 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:23:55,311 p=14044 u=mistral | Thursday 30 August 2018 12:23:55 -0400 (0:00:00.134) 0:10:15.090 ******* >2018-08-30 12:23:55,538 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:23:55,591 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:23:55,635 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:23:55,648 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:23:55,649 p=14044 u=mistral | Thursday 30 August 2018 12:23:55 -0400 (0:00:00.338) 0:10:15.428 ******* >2018-08-30 12:23:55,687 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:55,716 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:55,735 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:55,752 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:23:55,752 p=14044 u=mistral | Thursday 30 August 2018 12:23:55 -0400 (0:00:00.103) 0:10:15.531 ******* >2018-08-30 12:23:55,820 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:55,838 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:55,868 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:55,897 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:23:55,897 p=14044 u=mistral | Thursday 30 August 2018 12:23:55 -0400 (0:00:00.145) 0:10:15.676 ******* >2018-08-30 12:23:55,953 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:55,986 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:55,999 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,020 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:23:56,020 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.122) 0:10:15.799 ******* >2018-08-30 12:23:56,058 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:56,091 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:56,107 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,136 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:23:56,136 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.115) 0:10:15.915 ******* >2018-08-30 12:23:56,183 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:56,212 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:56,231 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,245 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:23:56,245 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.108) 0:10:16.024 ******* >2018-08-30 12:23:56,301 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:56,302 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:56,313 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,326 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:23:56,327 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.081) 0:10:16.106 ******* >2018-08-30 12:23:56,383 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:56,419 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:56,435 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:56,450 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:23:56,451 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.123) 0:10:16.230 ******* >2018-08-30 12:23:56,479 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:56,504 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:56,516 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,529 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:23:56,530 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.079) 0:10:16.309 ******* >2018-08-30 12:23:56,582 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:56,583 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:56,611 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,631 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:23:56,632 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.102) 0:10:16.411 ******* >2018-08-30 12:23:56,682 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:56,689 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:56,716 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,732 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:23:56,732 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.100) 0:10:16.511 ******* >2018-08-30 12:23:56,785 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:56,788 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:56,809 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:56,824 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:23:56,824 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.091) 0:10:16.603 ******* >2018-08-30 12:23:56,876 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/dev/vdb) >2018-08-30 12:23:56,881 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/dev/vdb) >2018-08-30 12:23:56,908 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/dev/vdb) >2018-08-30 12:23:56,922 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:23:56,923 p=14044 u=mistral | Thursday 30 August 2018 12:23:56 -0400 (0:00:00.098) 0:10:16.702 ******* >2018-08-30 12:23:56,975 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:23:56,979 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:23:57,003 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:23:57,018 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:23:57,018 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.095) 0:10:16.797 ******* >2018-08-30 12:23:57,072 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:57,073 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:57,095 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:57,110 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:23:57,111 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.092) 0:10:16.890 ******* >2018-08-30 12:23:57,154 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:57,177 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:57,193 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:57,208 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:23:57,208 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.097) 0:10:16.987 ******* >2018-08-30 12:23:57,260 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:57,261 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:57,279 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:57,293 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:23:57,293 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.085) 0:10:17.073 ******* >2018-08-30 12:23:57,344 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:57,352 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:57,368 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:57,381 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:23:57,381 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.087) 0:10:17.160 ******* >2018-08-30 12:23:57,443 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:23:57,445 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:23:57,464 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:23:57,480 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:23:57,480 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.098) 0:10:17.259 ******* >2018-08-30 12:23:57,540 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:57,564 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:57,599 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:57,613 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:23:57,614 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.133) 0:10:17.393 ******* >2018-08-30 12:23:57,673 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:23:57,693 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:23:57,716 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:23:57,731 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:23:57,731 p=14044 u=mistral | Thursday 30 August 2018 12:23:57 -0400 (0:00:00.117) 0:10:17.510 ******* >2018-08-30 12:23:58,070 p=14044 u=mistral | ok: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:23:58,081 p=14044 u=mistral | ok: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:23:58,143 p=14044 u=mistral | ok: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:23:58,366 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/) >2018-08-30 12:23:58,374 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/) >2018-08-30 12:23:58,459 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/) >2018-08-30 12:23:58,692 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mon) >2018-08-30 12:23:58,705 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mon) >2018-08-30 12:23:58,777 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mon) >2018-08-30 12:23:58,975 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/osd) >2018-08-30 12:23:58,982 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/osd) >2018-08-30 12:23:59,072 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/osd) >2018-08-30 12:23:59,273 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mds) >2018-08-30 12:23:59,277 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mds) >2018-08-30 12:23:59,349 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mds) >2018-08-30 12:23:59,550 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/tmp) >2018-08-30 12:23:59,565 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/tmp) >2018-08-30 12:23:59,645 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/tmp) >2018-08-30 12:23:59,842 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:23:59,849 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:23:59,930 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:24:00,371 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:24:00,374 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:24:00,446 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:24:00,681 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:24:00,689 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:24:00,770 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:24:01,002 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:24:01,006 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:24:01,090 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:24:01,306 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:24:01,379 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:24:01,397 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:24:01,604 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:24:01,691 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:24:01,724 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:24:01,745 p=14044 u=mistral | TASK [set_fact docker_exec_cmd_osd] ******************************************** >2018-08-30 12:24:01,746 p=14044 u=mistral | Thursday 30 August 2018 12:24:01 -0400 (0:00:04.014) 0:10:21.525 ******* >2018-08-30 12:24:01,828 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:24:01,849 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:24:01,886 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:24:01,918 p=14044 u=mistral | TASK [unset osd flags] ********************************************************* >2018-08-30 12:24:01,918 p=14044 u=mistral | Thursday 30 August 2018 12:24:01 -0400 (0:00:00.172) 0:10:21.697 ******* >2018-08-30 12:24:03,670 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] => (item=noout) >2018-08-30 12:24:03,688 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] => (item=noout) >2018-08-30 12:24:03,711 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] => (item=noout) >2018-08-30 12:24:04,777 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] => (item=noscrub) >2018-08-30 12:24:05,792 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] => (item=noscrub) >2018-08-30 12:24:05,796 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] => (item=nodeep-scrub) >2018-08-30 12:24:05,832 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] => (item=noscrub) >2018-08-30 12:24:07,688 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] => (item=nodeep-scrub) >2018-08-30 12:24:07,715 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] => (item=nodeep-scrub) >2018-08-30 12:24:07,742 p=14044 u=mistral | TASK [get osd versions] ******************************************************** >2018-08-30 12:24:07,743 p=14044 u=mistral | Thursday 30 August 2018 12:24:07 -0400 (0:00:05.824) 0:10:27.522 ******* >2018-08-30 12:24:08,843 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:24:09,029 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:24:09,089 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:24:09,115 p=14044 u=mistral | TASK [set_fact ceph_versions_osd] ********************************************** >2018-08-30 12:24:09,116 p=14044 u=mistral | Thursday 30 August 2018 12:24:09 -0400 (0:00:01.373) 0:10:28.895 ******* >2018-08-30 12:24:09,198 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:24:09,214 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:24:09,258 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:24:09,288 p=14044 u=mistral | TASK [complete osds upgrade] *************************************************** >2018-08-30 12:24:09,288 p=14044 u=mistral | Thursday 30 August 2018 12:24:09 -0400 (0:00:00.172) 0:10:29.067 ******* >2018-08-30 12:24:10,797 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:24:10,826 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:24:10,829 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:24:10,837 p=14044 u=mistral | PLAY [upgrade ceph mdss cluster] *********************************************** >2018-08-30 12:24:10,837 p=14044 u=mistral | skipping: no hosts matched >2018-08-30 12:24:10,842 p=14044 u=mistral | PLAY [upgrade ceph rgws cluster] *********************************************** >2018-08-30 12:24:10,842 p=14044 u=mistral | skipping: no hosts matched >2018-08-30 12:24:10,846 p=14044 u=mistral | PLAY [upgrade ceph rbd mirror node] ******************************************** >2018-08-30 12:24:10,846 p=14044 u=mistral | skipping: no hosts matched >2018-08-30 12:24:10,850 p=14044 u=mistral | PLAY [upgrade ceph nfs node] *************************************************** >2018-08-30 12:24:10,851 p=14044 u=mistral | skipping: no hosts matched >2018-08-30 12:24:10,865 p=14044 u=mistral | PLAY [upgrade ceph client node] ************************************************ >2018-08-30 12:24:10,967 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:24:10,967 p=14044 u=mistral | Thursday 30 August 2018 12:24:10 -0400 (0:00:01.679) 0:10:30.747 ******* >2018-08-30 12:24:10,994 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,009 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:24:11,010 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.042) 0:10:30.789 ******* >2018-08-30 12:24:11,036 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,051 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:24:11,051 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.041) 0:10:30.830 ******* >2018-08-30 12:24:11,080 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,095 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:24:11,096 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.044) 0:10:30.875 ******* >2018-08-30 12:24:11,126 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,141 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:24:11,141 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.045) 0:10:30.920 ******* >2018-08-30 12:24:11,172 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,191 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:24:11,191 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.049) 0:10:30.970 ******* >2018-08-30 12:24:11,221 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,236 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:24:11,237 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.045) 0:10:31.016 ******* >2018-08-30 12:24:11,273 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,289 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:24:11,289 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.052) 0:10:31.069 ******* >2018-08-30 12:24:11,319 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,333 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:24:11,334 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.044) 0:10:31.113 ******* >2018-08-30 12:24:11,363 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,380 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:24:11,380 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.046) 0:10:31.159 ******* >2018-08-30 12:24:11,406 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,422 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:24:11,422 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.041) 0:10:31.201 ******* >2018-08-30 12:24:11,449 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,465 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:24:11,465 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.043) 0:10:31.245 ******* >2018-08-30 12:24:11,494 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,509 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:24:11,509 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.043) 0:10:31.288 ******* >2018-08-30 12:24:11,538 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,553 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:24:11,554 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.044) 0:10:31.333 ******* >2018-08-30 12:24:11,583 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,609 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:24:11,610 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.056) 0:10:31.389 ******* >2018-08-30 12:24:11,642 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,660 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:24:11,660 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.050) 0:10:31.439 ******* >2018-08-30 12:24:11,690 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,708 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:24:11,708 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.048) 0:10:31.488 ******* >2018-08-30 12:24:11,740 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,758 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:24:11,758 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.050) 0:10:31.538 ******* >2018-08-30 12:24:11,789 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,806 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:24:11,806 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.047) 0:10:31.585 ******* >2018-08-30 12:24:11,833 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,852 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:24:11,852 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.046) 0:10:31.631 ******* >2018-08-30 12:24:11,884 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,902 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:24:11,902 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.049) 0:10:31.681 ******* >2018-08-30 12:24:11,933 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:11,948 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:24:11,948 p=14044 u=mistral | Thursday 30 August 2018 12:24:11 -0400 (0:00:00.046) 0:10:31.727 ******* >2018-08-30 12:24:11,990 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:12,005 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:24:12,006 p=14044 u=mistral | Thursday 30 August 2018 12:24:12 -0400 (0:00:00.057) 0:10:31.785 ******* >2018-08-30 12:24:12,039 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:12,055 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:24:12,055 p=14044 u=mistral | Thursday 30 August 2018 12:24:12 -0400 (0:00:00.049) 0:10:31.834 ******* >2018-08-30 12:24:12,086 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:12,101 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:24:12,101 p=14044 u=mistral | Thursday 30 August 2018 12:24:12 -0400 (0:00:00.046) 0:10:31.881 ******* >2018-08-30 12:24:12,134 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:12,150 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:24:12,150 p=14044 u=mistral | Thursday 30 August 2018 12:24:12 -0400 (0:00:00.048) 0:10:31.930 ******* >2018-08-30 12:24:12,183 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:12,198 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:24:12,198 p=14044 u=mistral | Thursday 30 August 2018 12:24:12 -0400 (0:00:00.047) 0:10:31.977 ******* >2018-08-30 12:24:12,227 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:12,243 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:24:12,244 p=14044 u=mistral | Thursday 30 August 2018 12:24:12 -0400 (0:00:00.045) 0:10:32.023 ******* >2018-08-30 12:24:12,274 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:12,291 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:24:12,291 p=14044 u=mistral | Thursday 30 August 2018 12:24:12 -0400 (0:00:00.047) 0:10:32.071 ******* >2018-08-30 12:24:13,065 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:13,081 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:24:13,081 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.789) 0:10:32.860 ******* >2018-08-30 12:24:13,137 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:13,154 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:24:13,154 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.072) 0:10:32.933 ******* >2018-08-30 12:24:13,213 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:13,233 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:24:13,234 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.079) 0:10:33.013 ******* >2018-08-30 12:24:13,258 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:13,289 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:24:13,289 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.055) 0:10:33.068 ******* >2018-08-30 12:24:13,390 p=14044 u=mistral | ok: [172.16.0.22 -> 172.16.0.33] >2018-08-30 12:24:13,426 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:24:13,427 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.137) 0:10:33.206 ******* >2018-08-30 12:24:13,459 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:13,487 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:24:13,487 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.060) 0:10:33.266 ******* >2018-08-30 12:24:13,727 p=14044 u=mistral | ok: [172.16.0.22 -> localhost] >2018-08-30 12:24:13,745 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:24:13,745 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.258) 0:10:33.524 ******* >2018-08-30 12:24:13,806 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:13,828 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:24:13,829 p=14044 u=mistral | Thursday 30 August 2018 12:24:13 -0400 (0:00:00.083) 0:10:33.608 ******* >2018-08-30 12:24:14,114 p=14044 u=mistral | ok: [172.16.0.22 -> localhost] >2018-08-30 12:24:14,135 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:24:14,136 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.306) 0:10:33.915 ******* >2018-08-30 12:24:14,165 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,180 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:24:14,181 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.044) 0:10:33.960 ******* >2018-08-30 12:24:14,240 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:14,262 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:24:14,263 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.082) 0:10:34.042 ******* >2018-08-30 12:24:14,291 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,312 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:24:14,312 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.049) 0:10:34.091 ******* >2018-08-30 12:24:14,342 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,366 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:24:14,366 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.053) 0:10:34.145 ******* >2018-08-30 12:24:14,388 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,406 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:24:14,406 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.040) 0:10:34.185 ******* >2018-08-30 12:24:14,429 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,454 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:24:14,455 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.048) 0:10:34.234 ******* >2018-08-30 12:24:14,521 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:14,536 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:24:14,537 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.082) 0:10:34.316 ******* >2018-08-30 12:24:14,560 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,579 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:24:14,579 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.042) 0:10:34.358 ******* >2018-08-30 12:24:14,636 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:14,653 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:24:14,653 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.073) 0:10:34.432 ******* >2018-08-30 12:24:14,712 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:14,727 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:24:14,728 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.074) 0:10:34.507 ******* >2018-08-30 12:24:14,794 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:14,809 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:24:14,809 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.081) 0:10:34.588 ******* >2018-08-30 12:24:14,843 p=14044 u=mistral | skipping: [172.16.0.22] => (item=/dev/vdb) >2018-08-30 12:24:14,859 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:24:14,859 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.049) 0:10:34.638 ******* >2018-08-30 12:24:14,892 p=14044 u=mistral | skipping: [172.16.0.22] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:24:14,908 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:24:14,908 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.048) 0:10:34.687 ******* >2018-08-30 12:24:14,935 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,950 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:24:14,950 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.041) 0:10:34.729 ******* >2018-08-30 12:24:14,973 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:14,987 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:24:14,987 p=14044 u=mistral | Thursday 30 August 2018 12:24:14 -0400 (0:00:00.036) 0:10:34.766 ******* >2018-08-30 12:24:15,009 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:15,023 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:24:15,023 p=14044 u=mistral | Thursday 30 August 2018 12:24:15 -0400 (0:00:00.036) 0:10:34.802 ******* >2018-08-30 12:24:15,048 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:15,063 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:24:15,063 p=14044 u=mistral | Thursday 30 August 2018 12:24:15 -0400 (0:00:00.039) 0:10:34.842 ******* >2018-08-30 12:24:15,107 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:15,129 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:24:15,129 p=14044 u=mistral | Thursday 30 August 2018 12:24:15 -0400 (0:00:00.065) 0:10:34.908 ******* >2018-08-30 12:24:15,191 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:15,206 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:24:15,207 p=14044 u=mistral | Thursday 30 August 2018 12:24:15 -0400 (0:00:00.077) 0:10:34.986 ******* >2018-08-30 12:24:15,258 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:15,276 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:24:15,276 p=14044 u=mistral | Thursday 30 August 2018 12:24:15 -0400 (0:00:00.069) 0:10:35.055 ******* >2018-08-30 12:24:15,635 p=14044 u=mistral | changed: [172.16.0.22] => (item=/etc/ceph) >2018-08-30 12:24:15,929 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/) >2018-08-30 12:24:16,237 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/mon) >2018-08-30 12:24:16,539 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/osd) >2018-08-30 12:24:17,058 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/mds) >2018-08-30 12:24:17,347 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/tmp) >2018-08-30 12:24:17,632 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:24:17,914 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:24:18,200 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:24:18,509 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:24:18,794 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:24:19,072 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/run/ceph) >2018-08-30 12:24:19,094 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:24:19,094 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:03.817) 0:10:38.873 ******* >2018-08-30 12:24:19,122 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,138 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:24:19,138 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.044) 0:10:38.918 ******* >2018-08-30 12:24:19,166 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,186 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:24:19,187 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.048) 0:10:38.966 ******* >2018-08-30 12:24:19,212 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,229 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:24:19,229 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.042) 0:10:39.009 ******* >2018-08-30 12:24:19,257 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,275 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:24:19,276 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.046) 0:10:39.055 ******* >2018-08-30 12:24:19,308 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,331 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:24:19,332 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.056) 0:10:39.111 ******* >2018-08-30 12:24:19,359 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,380 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:24:19,380 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.048) 0:10:39.159 ******* >2018-08-30 12:24:19,406 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,426 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:24:19,427 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.046) 0:10:39.206 ******* >2018-08-30 12:24:19,450 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,467 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:24:19,468 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.041) 0:10:39.247 ******* >2018-08-30 12:24:19,495 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,510 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:24:19,510 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.042) 0:10:39.290 ******* >2018-08-30 12:24:19,538 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,553 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:24:19,553 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.042) 0:10:39.332 ******* >2018-08-30 12:24:19,586 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,604 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:24:19,604 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.050) 0:10:39.383 ******* >2018-08-30 12:24:19,634 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,650 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:24:19,650 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.046) 0:10:39.429 ******* >2018-08-30 12:24:19,676 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,692 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:24:19,693 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.042) 0:10:39.472 ******* >2018-08-30 12:24:19,719 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,736 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:24:19,736 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.043) 0:10:39.516 ******* >2018-08-30 12:24:19,763 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,777 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:24:19,778 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.041) 0:10:39.557 ******* >2018-08-30 12:24:19,808 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,821 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:24:19,821 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.043) 0:10:39.601 ******* >2018-08-30 12:24:19,850 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,864 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:24:19,864 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.042) 0:10:39.643 ******* >2018-08-30 12:24:19,893 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,907 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:24:19,908 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.043) 0:10:39.687 ******* >2018-08-30 12:24:19,935 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,949 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:24:19,949 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.041) 0:10:39.728 ******* >2018-08-30 12:24:19,979 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:19,994 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:24:19,995 p=14044 u=mistral | Thursday 30 August 2018 12:24:19 -0400 (0:00:00.045) 0:10:39.774 ******* >2018-08-30 12:24:20,018 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,032 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:24:20,032 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.037) 0:10:39.811 ******* >2018-08-30 12:24:20,058 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,074 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:24:20,074 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.041) 0:10:39.853 ******* >2018-08-30 12:24:20,099 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,114 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:24:20,114 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.040) 0:10:39.894 ******* >2018-08-30 12:24:20,140 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,160 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:24:20,160 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.045) 0:10:39.939 ******* >2018-08-30 12:24:20,190 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,205 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:24:20,206 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.045) 0:10:39.985 ******* >2018-08-30 12:24:20,235 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,253 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:24:20,254 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.047) 0:10:40.033 ******* >2018-08-30 12:24:20,283 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,303 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-compute01/keyring already exists] *** >2018-08-30 12:24:20,304 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.049) 0:10:40.083 ******* >2018-08-30 12:24:20,337 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,354 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-compute01/keyring doesn't exist] *** >2018-08-30 12:24:20,354 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.050) 0:10:40.133 ******* >2018-08-30 12:24:20,392 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,409 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:24:20,410 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.055) 0:10:40.189 ******* >2018-08-30 12:24:20,438 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,459 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:24:20,459 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.049) 0:10:40.238 ******* >2018-08-30 12:24:20,491 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,516 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:24:20,516 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.056) 0:10:40.295 ******* >2018-08-30 12:24:20,546 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,579 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:24:20,579 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.063) 0:10:40.359 ******* >2018-08-30 12:24:20,609 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,627 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:24:20,627 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.047) 0:10:40.406 ******* >2018-08-30 12:24:20,651 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,667 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:24:20,667 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.040) 0:10:40.446 ******* >2018-08-30 12:24:20,709 p=14044 u=mistral | skipping: [172.16.0.22] => (item=/var/run/ceph) >2018-08-30 12:24:20,712 p=14044 u=mistral | skipping: [172.16.0.22] => (item=/var/log/ceph) >2018-08-30 12:24:20,731 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:24:20,732 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.064) 0:10:40.511 ******* >2018-08-30 12:24:20,769 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,786 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:24:20,787 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.054) 0:10:40.566 ******* >2018-08-30 12:24:20,816 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,831 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:24:20,831 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.044) 0:10:40.611 ******* >2018-08-30 12:24:20,859 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,879 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:24:20,879 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.047) 0:10:40.658 ******* >2018-08-30 12:24:20,907 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,924 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:24:20,924 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.044) 0:10:40.703 ******* >2018-08-30 12:24:20,954 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:20,972 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:24:20,972 p=14044 u=mistral | Thursday 30 August 2018 12:24:20 -0400 (0:00:00.048) 0:10:40.752 ******* >2018-08-30 12:24:21,006 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:21,022 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:24:21,023 p=14044 u=mistral | Thursday 30 August 2018 12:24:21 -0400 (0:00:00.050) 0:10:40.802 ******* >2018-08-30 12:24:21,051 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:21,067 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:24:21,067 p=14044 u=mistral | Thursday 30 August 2018 12:24:21 -0400 (0:00:00.044) 0:10:40.846 ******* >2018-08-30 12:24:21,095 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:21,111 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:24:21,112 p=14044 u=mistral | Thursday 30 August 2018 12:24:21 -0400 (0:00:00.044) 0:10:40.891 ******* >2018-08-30 12:24:21,140 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:21,157 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:24:21,158 p=14044 u=mistral | Thursday 30 August 2018 12:24:21 -0400 (0:00:00.046) 0:10:40.937 ******* >2018-08-30 12:24:21,490 p=14044 u=mistral | ok: [172.16.0.22] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:24:21,770 p=14044 u=mistral | ok: [172.16.0.22] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:24:21,786 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:24:21,787 p=14044 u=mistral | Thursday 30 August 2018 12:24:21 -0400 (0:00:00.628) 0:10:41.566 ******* >2018-08-30 12:24:21,849 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:21,863 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:24:21,864 p=14044 u=mistral | Thursday 30 August 2018 12:24:21 -0400 (0:00:00.076) 0:10:41.643 ******* >2018-08-30 12:24:21,887 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:21,901 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:24:21,902 p=14044 u=mistral | Thursday 30 August 2018 12:24:21 -0400 (0:00:00.038) 0:10:41.681 ******* >2018-08-30 12:24:22,256 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:22,271 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:24:22,271 p=14044 u=mistral | Thursday 30 August 2018 12:24:22 -0400 (0:00:00.369) 0:10:42.050 ******* >2018-08-30 12:24:22,322 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:22,336 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:24:22,336 p=14044 u=mistral | Thursday 30 August 2018 12:24:22 -0400 (0:00:00.064) 0:10:42.115 ******* >2018-08-30 12:24:22,673 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:22,689 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:24:22,690 p=14044 u=mistral | Thursday 30 August 2018 12:24:22 -0400 (0:00:00.353) 0:10:42.469 ******* >2018-08-30 12:24:22,722 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:22,740 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:24:22,740 p=14044 u=mistral | Thursday 30 August 2018 12:24:22 -0400 (0:00:00.050) 0:10:42.519 ******* >2018-08-30 12:24:22,784 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.33) >2018-08-30 12:24:22,808 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.24) >2018-08-30 12:24:22,818 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.25) >2018-08-30 12:24:22,836 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:24:22,836 p=14044 u=mistral | Thursday 30 August 2018 12:24:22 -0400 (0:00:00.096) 0:10:42.616 ******* >2018-08-30 12:24:22,872 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:22,890 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:24:22,890 p=14044 u=mistral | Thursday 30 August 2018 12:24:22 -0400 (0:00:00.053) 0:10:42.670 ******* >2018-08-30 12:24:22,925 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:22,950 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:24:22,950 p=14044 u=mistral | Thursday 30 August 2018 12:24:22 -0400 (0:00:00.059) 0:10:42.730 ******* >2018-08-30 12:24:22,988 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,002 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:24:23,003 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.052) 0:10:42.782 ******* >2018-08-30 12:24:23,035 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,050 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:24:23,051 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.047) 0:10:42.830 ******* >2018-08-30 12:24:23,073 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,088 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:24:23,088 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.037) 0:10:42.868 ******* >2018-08-30 12:24:23,112 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,128 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:24:23,128 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.039) 0:10:42.907 ******* >2018-08-30 12:24:23,163 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,181 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:24:23,181 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.052) 0:10:42.960 ******* >2018-08-30 12:24:23,216 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,231 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:24:23,231 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.050) 0:10:43.011 ******* >2018-08-30 12:24:23,264 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,282 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:24:23,282 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.050) 0:10:43.061 ******* >2018-08-30 12:24:23,315 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,335 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:24:23,335 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.052) 0:10:43.114 ******* >2018-08-30 12:24:23,366 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,382 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:24:23,382 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.047) 0:10:43.161 ******* >2018-08-30 12:24:23,412 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,427 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:24:23,427 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.045) 0:10:43.207 ******* >2018-08-30 12:24:23,454 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,469 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:24:23,469 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.041) 0:10:43.248 ******* >2018-08-30 12:24:23,496 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,511 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:24:23,511 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.041) 0:10:43.290 ******* >2018-08-30 12:24:23,547 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,569 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:24:23,569 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.057) 0:10:43.348 ******* >2018-08-30 12:24:23,605 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,627 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:24:23,628 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.058) 0:10:43.407 ******* >2018-08-30 12:24:23,660 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,679 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:24:23,679 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.051) 0:10:43.458 ******* >2018-08-30 12:24:23,712 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,729 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:24:23,730 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.050) 0:10:43.509 ******* >2018-08-30 12:24:23,766 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,784 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:24:23,784 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.054) 0:10:43.563 ******* >2018-08-30 12:24:23,814 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,832 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:24:23,833 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.048) 0:10:43.612 ******* >2018-08-30 12:24:23,861 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,879 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:24:23,879 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.046) 0:10:43.658 ******* >2018-08-30 12:24:23,912 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,933 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:24:23,934 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.054) 0:10:43.713 ******* >2018-08-30 12:24:23,964 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:23,980 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:24:23,980 p=14044 u=mistral | Thursday 30 August 2018 12:24:23 -0400 (0:00:00.046) 0:10:43.759 ******* >2018-08-30 12:24:24,015 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,029 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:24:24,030 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.049) 0:10:43.809 ******* >2018-08-30 12:24:24,058 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,073 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:24:24,073 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.043) 0:10:43.853 ******* >2018-08-30 12:24:24,101 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,116 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:24:24,117 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.043) 0:10:43.896 ******* >2018-08-30 12:24:24,145 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,160 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:24:24,160 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.043) 0:10:43.939 ******* >2018-08-30 12:24:24,188 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,203 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:24:24,203 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.043) 0:10:43.982 ******* >2018-08-30 12:24:24,233 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,247 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:24:24,247 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.044) 0:10:44.027 ******* >2018-08-30 12:24:24,274 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,292 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:24:24,293 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.045) 0:10:44.072 ******* >2018-08-30 12:24:24,324 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,340 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:24:24,340 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.047) 0:10:44.120 ******* >2018-08-30 12:24:24,374 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,391 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:24:24,392 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.051) 0:10:44.171 ******* >2018-08-30 12:24:24,426 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:24,445 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:24:24,446 p=14044 u=mistral | Thursday 30 August 2018 12:24:24 -0400 (0:00:00.054) 0:10:44.225 ******* >2018-08-30 12:24:45,858 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:45,877 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:24:45,877 p=14044 u=mistral | Thursday 30 August 2018 12:24:45 -0400 (0:00:21.431) 0:11:05.657 ******* >2018-08-30 12:24:46,259 p=14044 u=mistral | changed: [172.16.0.22] >2018-08-30 12:24:46,285 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:24:46,286 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.407) 0:11:06.065 ******* >2018-08-30 12:24:46,345 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:46,361 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:24:46,362 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.076) 0:11:06.141 ******* >2018-08-30 12:24:46,399 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,414 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:24:46,415 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.053) 0:11:06.194 ******* >2018-08-30 12:24:46,456 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,471 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:24:46,471 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.056) 0:11:06.251 ******* >2018-08-30 12:24:46,499 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,515 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:24:46,515 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.043) 0:11:06.295 ******* >2018-08-30 12:24:46,546 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,562 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:24:46,562 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.046) 0:11:06.341 ******* >2018-08-30 12:24:46,592 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,608 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:24:46,608 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.046) 0:11:06.387 ******* >2018-08-30 12:24:46,638 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,654 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:24:46,654 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.046) 0:11:06.434 ******* >2018-08-30 12:24:46,683 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,705 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:24:46,705 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.050) 0:11:06.484 ******* >2018-08-30 12:24:46,741 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,757 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:24:46,757 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.052) 0:11:06.537 ******* >2018-08-30 12:24:46,793 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,809 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:24:46,809 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.051) 0:11:06.588 ******* >2018-08-30 12:24:46,841 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,855 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:24:46,855 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.046) 0:11:06.635 ******* >2018-08-30 12:24:46,884 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:46,904 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:24:46,904 p=14044 u=mistral | Thursday 30 August 2018 12:24:46 -0400 (0:00:00.048) 0:11:06.683 ******* >2018-08-30 12:24:47,871 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:47,899 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:24:47,900 p=14044 u=mistral | Thursday 30 August 2018 12:24:47 -0400 (0:00:00.995) 0:11:07.679 ******* >2018-08-30 12:24:47,957 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:47,974 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:24:47,974 p=14044 u=mistral | Thursday 30 August 2018 12:24:47 -0400 (0:00:00.074) 0:11:07.753 ******* >2018-08-30 12:24:48,010 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:48,038 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:24:48,039 p=14044 u=mistral | Thursday 30 August 2018 12:24:48 -0400 (0:00:00.064) 0:11:07.818 ******* >2018-08-30 12:24:48,076 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:48,092 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:24:48,093 p=14044 u=mistral | Thursday 30 August 2018 12:24:48 -0400 (0:00:00.054) 0:11:07.872 ******* >2018-08-30 12:24:48,152 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:48,173 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:24:48,173 p=14044 u=mistral | Thursday 30 August 2018 12:24:48 -0400 (0:00:00.080) 0:11:07.953 ******* >2018-08-30 12:24:48,207 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:48,224 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:24:48,225 p=14044 u=mistral | Thursday 30 August 2018 12:24:48 -0400 (0:00:00.051) 0:11:08.004 ******* >2018-08-30 12:24:48,255 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:48,270 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:24:48,271 p=14044 u=mistral | Thursday 30 August 2018 12:24:48 -0400 (0:00:00.045) 0:11:08.050 ******* >2018-08-30 12:24:48,598 p=14044 u=mistral | changed: [172.16.0.22] => (item=/etc/ceph) >2018-08-30 12:24:48,897 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:24:49,189 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:24:49,723 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:24:50,008 p=14044 u=mistral | changed: [172.16.0.22] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:24:50,029 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:24:50,029 p=14044 u=mistral | Thursday 30 August 2018 12:24:50 -0400 (0:00:01.758) 0:11:09.808 ******* >2018-08-30 12:24:50,056 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:50,079 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:24:50,079 p=14044 u=mistral | Thursday 30 August 2018 12:24:50 -0400 (0:00:00.049) 0:11:09.858 ******* >2018-08-30 12:24:50,109 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:50,131 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:24:50,131 p=14044 u=mistral | Thursday 30 August 2018 12:24:50 -0400 (0:00:00.052) 0:11:09.910 ******* >2018-08-30 12:24:50,176 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:50,198 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:24:50,198 p=14044 u=mistral | Thursday 30 August 2018 12:24:50 -0400 (0:00:00.066) 0:11:09.977 ******* >2018-08-30 12:24:50,232 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:50,264 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:24:50,264 p=14044 u=mistral | Thursday 30 August 2018 12:24:50 -0400 (0:00:00.065) 0:11:10.043 ******* >2018-08-30 12:24:50,292 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:50,307 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:24:50,307 p=14044 u=mistral | Thursday 30 August 2018 12:24:50 -0400 (0:00:00.042) 0:11:10.086 ******* >2018-08-30 12:24:50,619 p=14044 u=mistral | changed: [172.16.0.22] >2018-08-30 12:24:50,637 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:24:50,638 p=14044 u=mistral | Thursday 30 August 2018 12:24:50 -0400 (0:00:00.330) 0:11:10.417 ******* >2018-08-30 12:24:53,120 p=14044 u=mistral | changed: [172.16.0.22] >2018-08-30 12:24:53,133 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:24:53,133 p=14044 u=mistral | Thursday 30 August 2018 12:24:53 -0400 (0:00:02.495) 0:11:12.913 ******* >2018-08-30 12:24:53,166 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:53,182 p=14044 u=mistral | TASK [ceph-client : copy ceph admin keyring when non containerized deployment] *** >2018-08-30 12:24:53,183 p=14044 u=mistral | Thursday 30 August 2018 12:24:53 -0400 (0:00:00.049) 0:11:12.962 ******* >2018-08-30 12:24:53,214 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:24:53,230 p=14044 u=mistral | TASK [ceph-client : set_fact keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:24:53,230 p=14044 u=mistral | Thursday 30 August 2018 12:24:53 -0400 (0:00:00.047) 0:11:13.009 ******* >2018-08-30 12:24:53,314 p=14044 u=mistral | ok: [172.16.0.22] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:24:53,342 p=14044 u=mistral | ok: [172.16.0.22] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:24:53,372 p=14044 u=mistral | ok: [172.16.0.22] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:24:53,397 p=14044 u=mistral | TASK [ceph-client : set_fact keys - override keys_tmp with keys] *************** >2018-08-30 12:24:53,397 p=14044 u=mistral | Thursday 30 August 2018 12:24:53 -0400 (0:00:00.167) 0:11:13.176 ******* >2018-08-30 12:24:53,462 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:53,478 p=14044 u=mistral | TASK [ceph-client : run a dummy container (sleep 300) from where we can create pool(s)/key(s)] *** >2018-08-30 12:24:53,479 p=14044 u=mistral | Thursday 30 August 2018 12:24:53 -0400 (0:00:00.081) 0:11:13.258 ******* >2018-08-30 12:24:54,127 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:54,145 p=14044 u=mistral | TASK [ceph-client : set_fact delegated_node] *********************************** >2018-08-30 12:24:54,146 p=14044 u=mistral | Thursday 30 August 2018 12:24:54 -0400 (0:00:00.667) 0:11:13.925 ******* >2018-08-30 12:24:54,205 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:54,221 p=14044 u=mistral | TASK [ceph-client : set_fact condition_copy_admin_key] ************************* >2018-08-30 12:24:54,221 p=14044 u=mistral | Thursday 30 August 2018 12:24:54 -0400 (0:00:00.075) 0:11:14.000 ******* >2018-08-30 12:24:54,278 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:54,294 p=14044 u=mistral | TASK [ceph-client : set_fact docker_exec_cmd] ********************************** >2018-08-30 12:24:54,295 p=14044 u=mistral | Thursday 30 August 2018 12:24:54 -0400 (0:00:00.073) 0:11:14.074 ******* >2018-08-30 12:24:54,385 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:54,415 p=14044 u=mistral | TASK [ceph-client : create cephx key(s)] *************************************** >2018-08-30 12:24:54,415 p=14044 u=mistral | Thursday 30 August 2018 12:24:54 -0400 (0:00:00.120) 0:11:14.194 ******* >2018-08-30 12:24:54,948 p=14044 u=mistral | changed: [172.16.0.22 -> 172.16.0.33] => (item={'caps': {'mds': u"''", 'osd': u"'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'", 'mon': u"'profile rbd'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:24:55,438 p=14044 u=mistral | changed: [172.16.0.22 -> 172.16.0.33] => (item={'caps': {'mds': u"'allow *'", 'osd': u"'allow rw'", 'mon': u'\'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"\'', 'mgr': u"'allow *'"}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:24:55,925 p=14044 u=mistral | changed: [172.16.0.22 -> 172.16.0.33] => (item={'caps': {'mds': u"''", 'osd': u"'allow rwx'", 'mon': u"'allow rw'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:24:55,960 p=14044 u=mistral | TASK [ceph-client : slurp client cephx key(s)] ********************************* >2018-08-30 12:24:55,961 p=14044 u=mistral | Thursday 30 August 2018 12:24:55 -0400 (0:00:01.545) 0:11:15.740 ******* >2018-08-30 12:24:56,302 p=14044 u=mistral | ok: [172.16.0.22 -> 172.16.0.33] => (item={'caps': {'mds': u"''", 'osd': u"'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'", 'mon': u"'profile rbd'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:24:56,599 p=14044 u=mistral | ok: [172.16.0.22 -> 172.16.0.33] => (item={'caps': {'mds': u"'allow *'", 'osd': u"'allow rw'", 'mon': u'\'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"\'', 'mgr': u"'allow *'"}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:24:57,236 p=14044 u=mistral | ok: [172.16.0.22 -> 172.16.0.33] => (item={'caps': {'mds': u"''", 'osd': u"'allow rwx'", 'mon': u"'allow rw'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:24:57,258 p=14044 u=mistral | TASK [ceph-client : list existing pool(s)] ************************************* >2018-08-30 12:24:57,259 p=14044 u=mistral | Thursday 30 August 2018 12:24:57 -0400 (0:00:01.298) 0:11:17.038 ******* >2018-08-30 12:24:57,317 p=14044 u=mistral | TASK [ceph-client : create ceph pool(s)] *************************************** >2018-08-30 12:24:57,318 p=14044 u=mistral | Thursday 30 August 2018 12:24:57 -0400 (0:00:00.058) 0:11:17.097 ******* >2018-08-30 12:24:57,369 p=14044 u=mistral | TASK [ceph-client : kill a dummy container that created pool(s)/key(s)] ******** >2018-08-30 12:24:57,369 p=14044 u=mistral | Thursday 30 August 2018 12:24:57 -0400 (0:00:00.051) 0:11:17.148 ******* >2018-08-30 12:24:57,916 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:24:57,936 p=14044 u=mistral | TASK [ceph-client : get client cephx keys] ************************************* >2018-08-30 12:24:57,937 p=14044 u=mistral | Thursday 30 August 2018 12:24:57 -0400 (0:00:00.567) 0:11:17.716 ******* >2018-08-30 12:24:58,852 p=14044 u=mistral | changed: [172.16.0.22] => (item={'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, u'encoding': u'base64', '_ansible_item_result': True, u'content': u'W2NsaWVudC5vcGVuc3RhY2tdCglrZXkgPSBBUUF0bFdOYkFBQUFBQkFBQ2pFMElvd1hvcFlLSmkrY3gwdTRQdz09CgljYXBzIG1kcyA9ICInJyIKCWNhcHMgbWdyID0gIidhbGxvdyAqJyIKCWNhcHMgbW9uID0gIidwcm9maWxlIHJiZCciCgljYXBzIG9zZCA9ICIncHJvZmlsZSByYmQgcG9vbD12b2x1bWVzLCBwcm9maWxlIHJiZCBwb29sPWJhY2t1cHMsIHByb2ZpbGUgcmJkIHBvb2w9dm1zLCBwcm9maWxlIHJiZCBwb29sPWltYWdlcywgcHJvZmlsZSByYmQgcG9vbD1tZXRyaWNzJyIK', 'failed': False, u'source': u'/etc/ceph/ceph.client.openstack.keyring', 'item': {'mode': u'0600', 'name': u'client.openstack', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u"''", 'osd': u"'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'", 'mgr': u"'allow *'", 'mon': u"'profile rbd'"}}, u'invocation': {u'module_args': {u'src': u'/etc/ceph/ceph.client.openstack.keyring'}}, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_ignore_errors': None}) >2018-08-30 12:24:59,579 p=14044 u=mistral | changed: [172.16.0.22] => (item={'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, u'encoding': u'base64', '_ansible_item_result': True, u'content': u'W2NsaWVudC5tYW5pbGFdCglrZXkgPSBBUUNROElkYkFBQUFBQkFBRWdkWG5kOUJISURJcmRjaldKOFZRdz09CgljYXBzIG1kcyA9ICInYWxsb3cgKiciCgljYXBzIG1nciA9ICInYWxsb3cgKiciCgljYXBzIG1vbiA9ICInYWxsb3cgciwgYWxsb3cgY29tbWFuZCBcImF1dGggZGVsXCIsIGFsbG93IGNvbW1hbmQgXCJhdXRoIGNhcHNcIiwgYWxsb3cgY29tbWFuZCBcImF1dGggZ2V0XCIsIGFsbG93IGNvbW1hbmQgXCJhdXRoIGdldC1vci1jcmVhdGVcIiciCgljYXBzIG9zZCA9ICInYWxsb3cgcncnIgo=', 'failed': False, u'source': u'/etc/ceph/ceph.client.manila.keyring', 'item': {'name': u'client.manila', 'mode': u'0600', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u"'allow *'", 'osd': u"'allow rw'", 'mgr': u"'allow *'", 'mon': u'\'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"\''}}, u'invocation': {u'module_args': {u'src': u'/etc/ceph/ceph.client.manila.keyring'}}, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_ignore_errors': None}) >2018-08-30 12:25:00,291 p=14044 u=mistral | changed: [172.16.0.22] => (item={'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, u'encoding': u'base64', '_ansible_item_result': True, u'content': u'W2NsaWVudC5yYWRvc2d3XQoJa2V5ID0gQVFBdGxXTmJBQUFBQUJBQVBRS0prcmNYZzB5c0duVHhBOGRzZ0E9PQoJY2FwcyBtZHMgPSAiJyciCgljYXBzIG1nciA9ICInYWxsb3cgKiciCgljYXBzIG1vbiA9ICInYWxsb3cgcncnIgoJY2FwcyBvc2QgPSAiJ2FsbG93IHJ3eCciCg==', 'failed': False, u'source': u'/etc/ceph/ceph.client.radosgw.keyring', 'item': {'mode': u'0600', 'name': u'client.radosgw', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u"''", 'osd': u"'allow rwx'", 'mgr': u"'allow *'", 'mon': u"'allow rw'"}}, u'invocation': {u'module_args': {u'src': u'/etc/ceph/ceph.client.radosgw.keyring'}}, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_ignore_errors': None}) >2018-08-30 12:25:00,297 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:25:00,297 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:02.360) 0:11:20.076 ******* >2018-08-30 12:25:00,361 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:00,362 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:25:00,362 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.064) 0:11:20.141 ******* >2018-08-30 12:25:00,404 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:25:00,404 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:25:00,405 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.042) 0:11:20.184 ******* >2018-08-30 12:25:00,495 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.33) >2018-08-30 12:25:00,510 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.24) >2018-08-30 12:25:00,510 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.25) >2018-08-30 12:25:00,512 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:25:00,512 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.107) 0:11:20.291 ******* >2018-08-30 12:25:00,607 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.33) >2018-08-30 12:25:00,616 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.24) >2018-08-30 12:25:00,621 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.25) >2018-08-30 12:25:00,623 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:25:00,623 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.111) 0:11:20.402 ******* >2018-08-30 12:25:00,691 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:00,692 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:25:00,692 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.069) 0:11:20.472 ******* >2018-08-30 12:25:00,770 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:00,771 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:25:00,772 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.079) 0:11:20.551 ******* >2018-08-30 12:25:00,815 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:25:00,816 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:25:00,816 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.044) 0:11:20.595 ******* >2018-08-30 12:25:00,908 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.28) >2018-08-30 12:25:00,915 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.36) >2018-08-30 12:25:00,922 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.32) >2018-08-30 12:25:00,924 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:25:00,924 p=14044 u=mistral | Thursday 30 August 2018 12:25:00 -0400 (0:00:00.107) 0:11:20.703 ******* >2018-08-30 12:25:01,003 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.28) >2018-08-30 12:25:01,008 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.36) >2018-08-30 12:25:01,016 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.32) >2018-08-30 12:25:01,017 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:25:01,018 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.093) 0:11:20.797 ******* >2018-08-30 12:25:01,082 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:01,083 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:25:01,083 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.065) 0:11:20.863 ******* >2018-08-30 12:25:01,147 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:01,148 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:25:01,148 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.064) 0:11:20.928 ******* >2018-08-30 12:25:01,190 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:25:01,190 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:25:01,191 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.042) 0:11:20.970 ******* >2018-08-30 12:25:01,235 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:25:01,236 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.045) 0:11:21.015 ******* >2018-08-30 12:25:01,290 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:25:01,291 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.054) 0:11:21.070 ******* >2018-08-30 12:25:01,356 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:01,357 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:25:01,357 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.066) 0:11:21.137 ******* >2018-08-30 12:25:01,423 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:01,424 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:25:01,425 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.067) 0:11:21.204 ******* >2018-08-30 12:25:01,465 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:25:01,466 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:25:01,466 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.041) 0:11:21.245 ******* >2018-08-30 12:25:01,509 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:25:01,510 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.044) 0:11:21.289 ******* >2018-08-30 12:25:01,564 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:25:01,565 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.055) 0:11:21.344 ******* >2018-08-30 12:25:01,643 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:01,644 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:25:01,644 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.079) 0:11:21.424 ******* >2018-08-30 12:25:01,713 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:01,714 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:25:01,715 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.070) 0:11:21.494 ******* >2018-08-30 12:25:01,762 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:25:01,763 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:25:01,764 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.049) 0:11:21.543 ******* >2018-08-30 12:25:01,818 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:25:01,818 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.054) 0:11:21.597 ******* >2018-08-30 12:25:01,866 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:25:01,867 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.048) 0:11:21.646 ******* >2018-08-30 12:25:01,952 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:01,953 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:25:01,954 p=14044 u=mistral | Thursday 30 August 2018 12:25:01 -0400 (0:00:00.086) 0:11:21.733 ******* >2018-08-30 12:25:02,022 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:02,022 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:25:02,023 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.069) 0:11:21.802 ******* >2018-08-30 12:25:02,065 p=14044 u=mistral | skipping: [172.16.0.22] >2018-08-30 12:25:02,066 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:25:02,066 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.043) 0:11:21.846 ******* >2018-08-30 12:25:02,164 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.33) >2018-08-30 12:25:02,171 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.24) >2018-08-30 12:25:02,178 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.25) >2018-08-30 12:25:02,181 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:25:02,181 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.114) 0:11:21.960 ******* >2018-08-30 12:25:02,279 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.33) >2018-08-30 12:25:02,285 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.24) >2018-08-30 12:25:02,291 p=14044 u=mistral | skipping: [172.16.0.22] => (item=172.16.0.25) >2018-08-30 12:25:02,294 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:25:02,294 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.113) 0:11:22.073 ******* >2018-08-30 12:25:02,361 p=14044 u=mistral | ok: [172.16.0.22] >2018-08-30 12:25:02,376 p=14044 u=mistral | PLAY [upgrade ceph client node] ************************************************ >2018-08-30 12:25:02,485 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:25:02,486 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.191) 0:11:22.265 ******* >2018-08-30 12:25:02,521 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,538 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:25:02,538 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.052) 0:11:22.317 ******* >2018-08-30 12:25:02,573 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,592 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:25:02,592 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.053) 0:11:22.371 ******* >2018-08-30 12:25:02,630 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,645 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:25:02,645 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.053) 0:11:22.424 ******* >2018-08-30 12:25:02,677 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,691 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:25:02,692 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.046) 0:11:22.471 ******* >2018-08-30 12:25:02,723 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,740 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:25:02,741 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.048) 0:11:22.520 ******* >2018-08-30 12:25:02,783 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,802 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:25:02,802 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.061) 0:11:22.581 ******* >2018-08-30 12:25:02,838 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,857 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:25:02,857 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.054) 0:11:22.636 ******* >2018-08-30 12:25:02,894 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,909 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:25:02,909 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.052) 0:11:22.688 ******* >2018-08-30 12:25:02,937 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:02,952 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:25:02,953 p=14044 u=mistral | Thursday 30 August 2018 12:25:02 -0400 (0:00:00.043) 0:11:22.732 ******* >2018-08-30 12:25:02,982 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,004 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:25:03,004 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.051) 0:11:22.783 ******* >2018-08-30 12:25:03,046 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,061 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:25:03,061 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.056) 0:11:22.840 ******* >2018-08-30 12:25:03,101 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,115 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:25:03,116 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.054) 0:11:22.895 ******* >2018-08-30 12:25:03,150 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,167 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:25:03,168 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.051) 0:11:22.947 ******* >2018-08-30 12:25:03,202 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,220 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:25:03,220 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.052) 0:11:22.999 ******* >2018-08-30 12:25:03,252 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,270 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:25:03,270 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.050) 0:11:23.049 ******* >2018-08-30 12:25:03,302 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,319 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:25:03,319 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.048) 0:11:23.098 ******* >2018-08-30 12:25:03,349 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,370 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:25:03,371 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.051) 0:11:23.150 ******* >2018-08-30 12:25:03,401 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,424 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:25:03,425 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.053) 0:11:23.204 ******* >2018-08-30 12:25:03,460 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,476 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:25:03,476 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.051) 0:11:23.256 ******* >2018-08-30 12:25:03,511 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,526 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:25:03,526 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.049) 0:11:23.305 ******* >2018-08-30 12:25:03,562 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,584 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:25:03,584 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.058) 0:11:23.364 ******* >2018-08-30 12:25:03,623 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,637 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:25:03,637 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.052) 0:11:23.417 ******* >2018-08-30 12:25:03,664 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,679 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:25:03,679 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.041) 0:11:23.458 ******* >2018-08-30 12:25:03,714 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,729 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:25:03,730 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.050) 0:11:23.509 ******* >2018-08-30 12:25:03,762 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,775 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:25:03,776 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.046) 0:11:23.555 ******* >2018-08-30 12:25:03,806 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,821 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:25:03,821 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.045) 0:11:23.600 ******* >2018-08-30 12:25:03,859 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,880 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:25:03,880 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.058) 0:11:23.659 ******* >2018-08-30 12:25:03,918 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:03,932 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:25:03,932 p=14044 u=mistral | Thursday 30 August 2018 12:25:03 -0400 (0:00:00.052) 0:11:23.712 ******* >2018-08-30 12:25:04,692 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:04,705 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:25:04,706 p=14044 u=mistral | Thursday 30 August 2018 12:25:04 -0400 (0:00:00.773) 0:11:24.485 ******* >2018-08-30 12:25:04,763 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:04,780 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:25:04,780 p=14044 u=mistral | Thursday 30 August 2018 12:25:04 -0400 (0:00:00.074) 0:11:24.559 ******* >2018-08-30 12:25:04,838 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:04,857 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:25:04,857 p=14044 u=mistral | Thursday 30 August 2018 12:25:04 -0400 (0:00:00.076) 0:11:24.637 ******* >2018-08-30 12:25:04,881 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:04,913 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:25:04,914 p=14044 u=mistral | Thursday 30 August 2018 12:25:04 -0400 (0:00:00.056) 0:11:24.693 ******* >2018-08-30 12:25:05,012 p=14044 u=mistral | ok: [172.16.0.31 -> 172.16.0.33] >2018-08-30 12:25:05,042 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:25:05,043 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.128) 0:11:24.822 ******* >2018-08-30 12:25:05,077 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:05,099 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:25:05,099 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.056) 0:11:24.878 ******* >2018-08-30 12:25:05,342 p=14044 u=mistral | ok: [172.16.0.31 -> localhost] >2018-08-30 12:25:05,364 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:25:05,364 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.265) 0:11:25.144 ******* >2018-08-30 12:25:05,429 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:05,465 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:25:05,465 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.100) 0:11:25.244 ******* >2018-08-30 12:25:05,720 p=14044 u=mistral | ok: [172.16.0.31 -> localhost] >2018-08-30 12:25:05,734 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:25:05,734 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.268) 0:11:25.513 ******* >2018-08-30 12:25:05,765 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:05,780 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:25:05,781 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.046) 0:11:25.560 ******* >2018-08-30 12:25:05,835 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:05,855 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:25:05,855 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.074) 0:11:25.635 ******* >2018-08-30 12:25:05,884 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:05,904 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:25:05,905 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.049) 0:11:25.684 ******* >2018-08-30 12:25:05,938 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:05,956 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:25:05,956 p=14044 u=mistral | Thursday 30 August 2018 12:25:05 -0400 (0:00:00.051) 0:11:25.735 ******* >2018-08-30 12:25:05,981 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,003 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:25:06,003 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.047) 0:11:25.783 ******* >2018-08-30 12:25:06,033 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,054 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:25:06,055 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.051) 0:11:25.834 ******* >2018-08-30 12:25:06,120 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:06,135 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:25:06,136 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.080) 0:11:25.915 ******* >2018-08-30 12:25:06,160 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,173 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:25:06,173 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.037) 0:11:25.953 ******* >2018-08-30 12:25:06,235 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:06,250 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:25:06,250 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.076) 0:11:26.030 ******* >2018-08-30 12:25:06,308 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:06,322 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:25:06,322 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.071) 0:11:26.101 ******* >2018-08-30 12:25:06,379 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:06,397 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:25:06,397 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.075) 0:11:26.176 ******* >2018-08-30 12:25:06,450 p=14044 u=mistral | skipping: [172.16.0.31] => (item=/dev/vdb) >2018-08-30 12:25:06,469 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:25:06,469 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.071) 0:11:26.248 ******* >2018-08-30 12:25:06,513 p=14044 u=mistral | skipping: [172.16.0.31] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:25:06,528 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:25:06,529 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.059) 0:11:26.308 ******* >2018-08-30 12:25:06,561 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,575 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:25:06,576 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.047) 0:11:26.355 ******* >2018-08-30 12:25:06,602 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,616 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:25:06,616 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.040) 0:11:26.396 ******* >2018-08-30 12:25:06,646 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,659 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:25:06,659 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.042) 0:11:26.438 ******* >2018-08-30 12:25:06,690 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,703 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:25:06,703 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.043) 0:11:26.482 ******* >2018-08-30 12:25:06,736 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:06,748 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:25:06,749 p=14044 u=mistral | Thursday 30 August 2018 12:25:06 -0400 (0:00:00.045) 0:11:26.528 ******* >2018-08-30 12:25:07,071 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:07,085 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:25:07,085 p=14044 u=mistral | Thursday 30 August 2018 12:25:07 -0400 (0:00:00.336) 0:11:26.864 ******* >2018-08-30 12:25:07,144 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:07,158 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:25:07,159 p=14044 u=mistral | Thursday 30 August 2018 12:25:07 -0400 (0:00:00.073) 0:11:26.938 ******* >2018-08-30 12:25:07,476 p=14044 u=mistral | changed: [172.16.0.31] => (item=/etc/ceph) >2018-08-30 12:25:08,001 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/) >2018-08-30 12:25:08,275 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/mon) >2018-08-30 12:25:08,531 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/osd) >2018-08-30 12:25:08,799 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/mds) >2018-08-30 12:25:09,075 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/tmp) >2018-08-30 12:25:09,352 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:25:09,642 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:25:09,928 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:25:10,215 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:25:10,489 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:25:10,772 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/run/ceph) >2018-08-30 12:25:10,792 p=14044 u=mistral | TASK [ceph-common : fail on unsupported system] ******************************** >2018-08-30 12:25:10,792 p=14044 u=mistral | Thursday 30 August 2018 12:25:10 -0400 (0:00:03.633) 0:11:30.571 ******* >2018-08-30 12:25:10,824 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:10,838 p=14044 u=mistral | TASK [ceph-common : fail on unsupported architecture] ************************** >2018-08-30 12:25:10,838 p=14044 u=mistral | Thursday 30 August 2018 12:25:10 -0400 (0:00:00.045) 0:11:30.617 ******* >2018-08-30 12:25:10,868 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:10,882 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution] ************************** >2018-08-30 12:25:10,882 p=14044 u=mistral | Thursday 30 August 2018 12:25:10 -0400 (0:00:00.044) 0:11:30.661 ******* >2018-08-30 12:25:10,912 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:10,934 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for red hat ceph storage] *** >2018-08-30 12:25:10,934 p=14044 u=mistral | Thursday 30 August 2018 12:25:10 -0400 (0:00:00.051) 0:11:30.713 ******* >2018-08-30 12:25:10,969 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:10,990 p=14044 u=mistral | TASK [ceph-common : determine if node is registered with subscription-manager] *** >2018-08-30 12:25:10,991 p=14044 u=mistral | Thursday 30 August 2018 12:25:10 -0400 (0:00:00.056) 0:11:30.770 ******* >2018-08-30 12:25:11,022 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,038 p=14044 u=mistral | TASK [ceph-common : fail on unregistered red hat rhcs linux] ******************* >2018-08-30 12:25:11,038 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.047) 0:11:30.818 ******* >2018-08-30 12:25:11,067 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,082 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for ubuntu cloud archive] *** >2018-08-30 12:25:11,082 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.043) 0:11:30.861 ******* >2018-08-30 12:25:11,111 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,125 p=14044 u=mistral | TASK [ceph-common : fail on unsupported openSUSE distribution] ***************** >2018-08-30 12:25:11,126 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.043) 0:11:30.905 ******* >2018-08-30 12:25:11,156 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,173 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:25:11,173 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.047) 0:11:30.952 ******* >2018-08-30 12:25:11,201 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,217 p=14044 u=mistral | TASK [ceph-common : fail on unsupported ansible version] *********************** >2018-08-30 12:25:11,217 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.044) 0:11:30.997 ******* >2018-08-30 12:25:11,246 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,260 p=14044 u=mistral | TASK [ceph-common : fail if systemd is not present] **************************** >2018-08-30 12:25:11,260 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.042) 0:11:31.039 ******* >2018-08-30 12:25:11,291 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,307 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution for iscsi gateways] ******* >2018-08-30 12:25:11,308 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.047) 0:11:31.087 ******* >2018-08-30 12:25:11,340 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,357 p=14044 u=mistral | TASK [ceph-common : fail on unsupported distribution version for iscsi gateways] *** >2018-08-30 12:25:11,358 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.050) 0:11:31.137 ******* >2018-08-30 12:25:11,388 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,402 p=14044 u=mistral | TASK [ceph-common : fail if local scenario is enabled on debian] *************** >2018-08-30 12:25:11,403 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.044) 0:11:31.182 ******* >2018-08-30 12:25:11,434 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,450 p=14044 u=mistral | TASK [ceph-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:25:11,450 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.047) 0:11:31.230 ******* >2018-08-30 12:25:11,482 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,498 p=14044 u=mistral | TASK [ceph-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:25:11,499 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.048) 0:11:31.278 ******* >2018-08-30 12:25:11,529 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,542 p=14044 u=mistral | TASK [ceph-common : include checks/check_firewall.yml] ************************* >2018-08-30 12:25:11,543 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.044) 0:11:31.322 ******* >2018-08-30 12:25:11,572 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,585 p=14044 u=mistral | TASK [ceph-common : include ntp debian setup tasks] **************************** >2018-08-30 12:25:11,585 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.042) 0:11:31.365 ******* >2018-08-30 12:25:11,610 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,626 p=14044 u=mistral | TASK [ceph-common : include ntp rpm setup tasks] ******************************* >2018-08-30 12:25:11,626 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.040) 0:11:31.405 ******* >2018-08-30 12:25:11,655 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,674 p=14044 u=mistral | TASK [ceph-common : get ceph version] ****************************************** >2018-08-30 12:25:11,674 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.047) 0:11:31.453 ******* >2018-08-30 12:25:11,707 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,722 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_version] ************************************* >2018-08-30 12:25:11,723 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.048) 0:11:31.502 ******* >2018-08-30 12:25:11,756 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,771 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release jewel] ******************************* >2018-08-30 12:25:11,772 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.048) 0:11:31.551 ******* >2018-08-30 12:25:11,808 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,822 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release kraken] ****************************** >2018-08-30 12:25:11,822 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.050) 0:11:31.601 ******* >2018-08-30 12:25:11,850 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,865 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release luminous] **************************** >2018-08-30 12:25:11,865 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.042) 0:11:31.644 ******* >2018-08-30 12:25:11,893 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,909 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release mimic] ******************************* >2018-08-30 12:25:11,909 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.043) 0:11:31.688 ******* >2018-08-30 12:25:11,938 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:11,952 p=14044 u=mistral | TASK [ceph-common : set_fact ceph_release nautilus] **************************** >2018-08-30 12:25:11,952 p=14044 u=mistral | Thursday 30 August 2018 12:25:11 -0400 (0:00:00.043) 0:11:31.731 ******* >2018-08-30 12:25:11,981 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,000 p=14044 u=mistral | TASK [ceph-common : include misc/configure_firewall_rpm.yml] ******************* >2018-08-30 12:25:12,001 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.048) 0:11:31.780 ******* >2018-08-30 12:25:12,029 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,048 p=14044 u=mistral | TASK [ceph-common : check if /var/lib/ceph/mon/ceph-lab-compute02/keyring already exists] *** >2018-08-30 12:25:12,048 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.046) 0:11:31.827 ******* >2018-08-30 12:25:12,078 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,094 p=14044 u=mistral | TASK [ceph-common : fail if /var/lib/ceph/mon/ceph-lab-compute02/keyring doesn't exist] *** >2018-08-30 12:25:12,094 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.046) 0:11:31.873 ******* >2018-08-30 12:25:12,123 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,140 p=14044 u=mistral | TASK [ceph-common : get existing initial mon keyring if it already exists but not monitor_keyring.conf in /tmp/file-mistral-actionLfF8RH] *** >2018-08-30 12:25:12,140 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.045) 0:11:31.919 ******* >2018-08-30 12:25:12,168 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,182 p=14044 u=mistral | TASK [ceph-common : test existing initial mon keyring] ************************* >2018-08-30 12:25:12,182 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.042) 0:11:31.962 ******* >2018-08-30 12:25:12,209 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,224 p=14044 u=mistral | TASK [ceph-common : fail if initial mon keyring found doesn't work] ************ >2018-08-30 12:25:12,225 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.042) 0:11:32.004 ******* >2018-08-30 12:25:12,252 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,278 p=14044 u=mistral | TASK [ceph-common : write initial mon keyring in /tmp/file-mistral-actionLfF8RH/monitor_keyring.conf if it doesn't exist] *** >2018-08-30 12:25:12,278 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.053) 0:11:32.057 ******* >2018-08-30 12:25:12,308 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,330 p=14044 u=mistral | TASK [ceph-common : put initial mon keyring in mon kv store] ******************* >2018-08-30 12:25:12,331 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.052) 0:11:32.110 ******* >2018-08-30 12:25:12,362 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,378 p=14044 u=mistral | TASK [ceph-common : create rbd client directory] ******************************* >2018-08-30 12:25:12,378 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.047) 0:11:32.157 ******* >2018-08-30 12:25:12,425 p=14044 u=mistral | skipping: [172.16.0.31] => (item=/var/run/ceph) >2018-08-30 12:25:12,433 p=14044 u=mistral | skipping: [172.16.0.31] => (item=/var/log/ceph) >2018-08-30 12:25:12,449 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:25:12,450 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.071) 0:11:32.229 ******* >2018-08-30 12:25:12,482 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,496 p=14044 u=mistral | TASK [ceph-common : check /etc/default/ceph exist] ***************************** >2018-08-30 12:25:12,497 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.046) 0:11:32.276 ******* >2018-08-30 12:25:12,525 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,539 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:25:12,539 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.042) 0:11:32.319 ******* >2018-08-30 12:25:12,567 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,581 p=14044 u=mistral | TASK [ceph-common : configure cluster name] ************************************ >2018-08-30 12:25:12,581 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.041) 0:11:32.360 ******* >2018-08-30 12:25:12,608 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,621 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for debian] *** >2018-08-30 12:25:12,621 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.039) 0:11:32.400 ******* >2018-08-30 12:25:12,651 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,665 p=14044 u=mistral | TASK [ceph-common : configure TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES for redhat] *** >2018-08-30 12:25:12,665 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.044) 0:11:32.445 ******* >2018-08-30 12:25:12,698 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,713 p=14044 u=mistral | TASK [ceph-docker-common : fail if systemd is not present] ********************* >2018-08-30 12:25:12,714 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.048) 0:11:32.493 ******* >2018-08-30 12:25:12,743 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,758 p=14044 u=mistral | TASK [ceph-docker-common : make sure monitor_interface, monitor_address or monitor_address_block is defined] *** >2018-08-30 12:25:12,758 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.044) 0:11:32.537 ******* >2018-08-30 12:25:12,789 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,804 p=14044 u=mistral | TASK [ceph-docker-common : make sure radosgw_interface, radosgw_address or radosgw_address_block is defined] *** >2018-08-30 12:25:12,805 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.046) 0:11:32.584 ******* >2018-08-30 12:25:12,834 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:12,855 p=14044 u=mistral | TASK [ceph-docker-common : remove ceph udev rules] ***************************** >2018-08-30 12:25:12,855 p=14044 u=mistral | Thursday 30 August 2018 12:25:12 -0400 (0:00:00.050) 0:11:32.634 ******* >2018-08-30 12:25:13,186 p=14044 u=mistral | ok: [172.16.0.31] => (item=/usr/lib/udev/rules.d/95-ceph-osd.rules) >2018-08-30 12:25:13,487 p=14044 u=mistral | ok: [172.16.0.31] => (item=/usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules) >2018-08-30 12:25:13,507 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_hostname] ************* >2018-08-30 12:25:13,508 p=14044 u=mistral | Thursday 30 August 2018 12:25:13 -0400 (0:00:00.652) 0:11:33.287 ******* >2018-08-30 12:25:13,568 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:13,582 p=14044 u=mistral | TASK [ceph-docker-common : set_fact monitor_name ansible_fqdn] ***************** >2018-08-30 12:25:13,582 p=14044 u=mistral | Thursday 30 August 2018 12:25:13 -0400 (0:00:00.074) 0:11:33.361 ******* >2018-08-30 12:25:13,609 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:13,622 p=14044 u=mistral | TASK [ceph-docker-common : get docker version] ********************************* >2018-08-30 12:25:13,622 p=14044 u=mistral | Thursday 30 August 2018 12:25:13 -0400 (0:00:00.039) 0:11:33.401 ******* >2018-08-30 12:25:13,986 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:14,007 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_docker_version ceph_docker_version.stdout.split] *** >2018-08-30 12:25:14,008 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.385) 0:11:33.787 ******* >2018-08-30 12:25:14,319 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:14,332 p=14044 u=mistral | TASK [ceph-docker-common : check if a cluster is already running] ************** >2018-08-30 12:25:14,332 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.324) 0:11:34.111 ******* >2018-08-30 12:25:14,663 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:14,684 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys] ************************** >2018-08-30 12:25:14,684 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.351) 0:11:34.463 ******* >2018-08-30 12:25:14,719 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:14,741 p=14044 u=mistral | TASK [ceph-docker-common : set_fact tmp_ceph_mgr_keys add mgr keys to config and keys paths] *** >2018-08-30 12:25:14,742 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.057) 0:11:34.521 ******* >2018-08-30 12:25:14,786 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.33) >2018-08-30 12:25:14,803 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.24) >2018-08-30 12:25:14,818 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.25) >2018-08-30 12:25:14,832 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_keys convert mgr keys to an array] *** >2018-08-30 12:25:14,833 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.091) 0:11:34.612 ******* >2018-08-30 12:25:14,865 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:14,883 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_config_keys merge mgr keys to config and keys paths] *** >2018-08-30 12:25:14,883 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.050) 0:11:34.662 ******* >2018-08-30 12:25:14,921 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:14,946 p=14044 u=mistral | TASK [ceph-docker-common : stat for ceph config and keys] ********************** >2018-08-30 12:25:14,946 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.062) 0:11:34.725 ******* >2018-08-30 12:25:14,983 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:14,997 p=14044 u=mistral | TASK [ceph-docker-common : fail if we find existing cluster files] ************* >2018-08-30 12:25:14,997 p=14044 u=mistral | Thursday 30 August 2018 12:25:14 -0400 (0:00:00.051) 0:11:34.777 ******* >2018-08-30 12:25:15,029 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,043 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on atomic] ******************* >2018-08-30 12:25:15,044 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.046) 0:11:34.823 ******* >2018-08-30 12:25:15,067 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,081 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:25:15,081 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.037) 0:11:34.861 ******* >2018-08-30 12:25:15,107 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,122 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on redhat or suse] *********** >2018-08-30 12:25:15,122 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.040) 0:11:34.901 ******* >2018-08-30 12:25:15,157 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,172 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on redhat or suse] ********************** >2018-08-30 12:25:15,173 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.050) 0:11:34.952 ******* >2018-08-30 12:25:15,206 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,220 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:25:15,220 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.047) 0:11:34.999 ******* >2018-08-30 12:25:15,250 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,267 p=14044 u=mistral | TASK [ceph-docker-common : check ntp installation on debian] ******************* >2018-08-30 12:25:15,267 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.047) 0:11:35.047 ******* >2018-08-30 12:25:15,297 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,312 p=14044 u=mistral | TASK [ceph-docker-common : install ntp on debian] ****************************** >2018-08-30 12:25:15,313 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.045) 0:11:35.092 ******* >2018-08-30 12:25:15,343 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,359 p=14044 u=mistral | TASK [ceph-docker-common : start the ntp service] ****************************** >2018-08-30 12:25:15,359 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.046) 0:11:35.139 ******* >2018-08-30 12:25:15,390 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,405 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mon container] ************************* >2018-08-30 12:25:15,406 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.046) 0:11:35.185 ******* >2018-08-30 12:25:15,433 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,447 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph osd container] ************************* >2018-08-30 12:25:15,447 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.041) 0:11:35.227 ******* >2018-08-30 12:25:15,478 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,496 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mds container] ************************* >2018-08-30 12:25:15,496 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.048) 0:11:35.275 ******* >2018-08-30 12:25:15,528 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,541 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rgw container] ************************* >2018-08-30 12:25:15,541 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.044) 0:11:35.320 ******* >2018-08-30 12:25:15,572 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,586 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph mgr container] ************************* >2018-08-30 12:25:15,586 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.045) 0:11:35.365 ******* >2018-08-30 12:25:15,612 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,625 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph rbd mirror container] ****************** >2018-08-30 12:25:15,626 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.039) 0:11:35.405 ******* >2018-08-30 12:25:15,650 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,662 p=14044 u=mistral | TASK [ceph-docker-common : inspect ceph nfs container] ************************* >2018-08-30 12:25:15,663 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.036) 0:11:35.442 ******* >2018-08-30 12:25:15,690 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,704 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mon container image before pulling] *** >2018-08-30 12:25:15,705 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.041) 0:11:35.484 ******* >2018-08-30 12:25:15,732 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,745 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph osd container image before pulling] *** >2018-08-30 12:25:15,746 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.040) 0:11:35.525 ******* >2018-08-30 12:25:15,773 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,785 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rgw container image before pulling] *** >2018-08-30 12:25:15,786 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.040) 0:11:35.565 ******* >2018-08-30 12:25:15,810 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,823 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mds container image before pulling] *** >2018-08-30 12:25:15,823 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.037) 0:11:35.602 ******* >2018-08-30 12:25:15,851 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,864 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph mgr container image before pulling] *** >2018-08-30 12:25:15,864 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.041) 0:11:35.643 ******* >2018-08-30 12:25:15,892 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,912 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph rbd mirror container image before pulling] *** >2018-08-30 12:25:15,913 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.048) 0:11:35.692 ******* >2018-08-30 12:25:15,946 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:15,966 p=14044 u=mistral | TASK [ceph-docker-common : inspecting ceph nfs container image before pulling] *** >2018-08-30 12:25:15,966 p=14044 u=mistral | Thursday 30 August 2018 12:25:15 -0400 (0:00:00.053) 0:11:35.745 ******* >2018-08-30 12:25:15,997 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,011 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_repodigest_before_pulling] *** >2018-08-30 12:25:16,011 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.045) 0:11:35.791 ******* >2018-08-30 12:25:16,045 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,060 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_repodigest_before_pulling] *** >2018-08-30 12:25:16,060 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.048) 0:11:35.839 ******* >2018-08-30 12:25:16,094 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,109 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_repodigest_before_pulling] *** >2018-08-30 12:25:16,110 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.049) 0:11:35.889 ******* >2018-08-30 12:25:16,140 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,155 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_repodigest_before_pulling] *** >2018-08-30 12:25:16,155 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.045) 0:11:35.934 ******* >2018-08-30 12:25:16,184 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,201 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_repodigest_before_pulling] *** >2018-08-30 12:25:16,201 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.046) 0:11:35.980 ******* >2018-08-30 12:25:16,227 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,242 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_repodigest_before_pulling] *** >2018-08-30 12:25:16,242 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.040) 0:11:36.021 ******* >2018-08-30 12:25:16,270 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,284 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_repodigest_before_pulling] *** >2018-08-30 12:25:16,284 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.042) 0:11:36.063 ******* >2018-08-30 12:25:16,311 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:16,327 p=14044 u=mistral | TASK [ceph-docker-common : pulling 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image] *** >2018-08-30 12:25:16,327 p=14044 u=mistral | Thursday 30 August 2018 12:25:16 -0400 (0:00:00.042) 0:11:36.106 ******* >2018-08-30 12:25:37,818 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:37,846 p=14044 u=mistral | TASK [ceph-docker-common : inspecting 172.16.0.1:8787/rhceph/rhceph-3-rhel7:3-12 image after pulling] *** >2018-08-30 12:25:37,846 p=14044 u=mistral | Thursday 30 August 2018 12:25:37 -0400 (0:00:21.518) 0:11:57.625 ******* >2018-08-30 12:25:38,503 p=14044 u=mistral | changed: [172.16.0.31] >2018-08-30 12:25:38,523 p=14044 u=mistral | TASK [ceph-docker-common : set_fact image_repodigest_after_pulling] ************ >2018-08-30 12:25:38,523 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.677) 0:11:58.303 ******* >2018-08-30 12:25:38,590 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:38,605 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mon_image_updated] ******************** >2018-08-30 12:25:38,605 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.081) 0:11:58.385 ******* >2018-08-30 12:25:38,631 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,645 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_osd_image_updated] ******************** >2018-08-30 12:25:38,646 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.040) 0:11:58.425 ******* >2018-08-30 12:25:38,673 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,687 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mds_image_updated] ******************** >2018-08-30 12:25:38,687 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.041) 0:11:58.467 ******* >2018-08-30 12:25:38,715 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,736 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rgw_image_updated] ******************** >2018-08-30 12:25:38,737 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.049) 0:11:58.516 ******* >2018-08-30 12:25:38,766 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,789 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_mgr_image_updated] ******************** >2018-08-30 12:25:38,790 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.052) 0:11:58.569 ******* >2018-08-30 12:25:38,818 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,831 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_rbd_mirror_image_updated] ************* >2018-08-30 12:25:38,832 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.041) 0:11:58.611 ******* >2018-08-30 12:25:38,857 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,870 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_nfs_image_updated] ******************** >2018-08-30 12:25:38,870 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.038) 0:11:58.649 ******* >2018-08-30 12:25:38,898 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,919 p=14044 u=mistral | TASK [ceph-docker-common : export local ceph dev image] ************************ >2018-08-30 12:25:38,919 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.049) 0:11:58.698 ******* >2018-08-30 12:25:38,952 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:38,969 p=14044 u=mistral | TASK [ceph-docker-common : copy ceph dev image file] *************************** >2018-08-30 12:25:38,970 p=14044 u=mistral | Thursday 30 August 2018 12:25:38 -0400 (0:00:00.050) 0:11:58.749 ******* >2018-08-30 12:25:39,004 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:39,022 p=14044 u=mistral | TASK [ceph-docker-common : load ceph dev image] ******************************** >2018-08-30 12:25:39,023 p=14044 u=mistral | Thursday 30 August 2018 12:25:39 -0400 (0:00:00.052) 0:11:58.802 ******* >2018-08-30 12:25:39,056 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:39,070 p=14044 u=mistral | TASK [ceph-docker-common : remove tmp ceph dev image file] ********************* >2018-08-30 12:25:39,071 p=14044 u=mistral | Thursday 30 August 2018 12:25:39 -0400 (0:00:00.047) 0:11:58.850 ******* >2018-08-30 12:25:39,105 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:39,121 p=14044 u=mistral | TASK [ceph-docker-common : get ceph version] *********************************** >2018-08-30 12:25:39,122 p=14044 u=mistral | Thursday 30 August 2018 12:25:39 -0400 (0:00:00.051) 0:11:58.901 ******* >2018-08-30 12:25:40,128 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:40,144 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_version ceph_version.stdout.split] **** >2018-08-30 12:25:40,145 p=14044 u=mistral | Thursday 30 August 2018 12:25:40 -0400 (0:00:01.022) 0:11:59.924 ******* >2018-08-30 12:25:40,478 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:40,493 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release jewel] ************************ >2018-08-30 12:25:40,493 p=14044 u=mistral | Thursday 30 August 2018 12:25:40 -0400 (0:00:00.348) 0:12:00.273 ******* >2018-08-30 12:25:40,524 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:40,537 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release kraken] *********************** >2018-08-30 12:25:40,537 p=14044 u=mistral | Thursday 30 August 2018 12:25:40 -0400 (0:00:00.043) 0:12:00.317 ******* >2018-08-30 12:25:40,572 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:40,585 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release luminous] ********************* >2018-08-30 12:25:40,585 p=14044 u=mistral | Thursday 30 August 2018 12:25:40 -0400 (0:00:00.047) 0:12:00.364 ******* >2018-08-30 12:25:40,659 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:40,673 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release mimic] ************************ >2018-08-30 12:25:40,673 p=14044 u=mistral | Thursday 30 August 2018 12:25:40 -0400 (0:00:00.087) 0:12:00.452 ******* >2018-08-30 12:25:40,706 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:40,719 p=14044 u=mistral | TASK [ceph-docker-common : set_fact ceph_release nautilus] ********************* >2018-08-30 12:25:40,720 p=14044 u=mistral | Thursday 30 August 2018 12:25:40 -0400 (0:00:00.046) 0:12:00.499 ******* >2018-08-30 12:25:40,753 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:40,767 p=14044 u=mistral | TASK [ceph-docker-common : create bootstrap directories] *********************** >2018-08-30 12:25:40,768 p=14044 u=mistral | Thursday 30 August 2018 12:25:40 -0400 (0:00:00.048) 0:12:00.547 ******* >2018-08-30 12:25:41,130 p=14044 u=mistral | changed: [172.16.0.31] => (item=/etc/ceph) >2018-08-30 12:25:41,706 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:25:42,004 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:25:42,313 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:25:42,605 p=14044 u=mistral | changed: [172.16.0.31] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:25:42,624 p=14044 u=mistral | TASK [ceph-config : create ceph conf directory] ******************************** >2018-08-30 12:25:42,624 p=14044 u=mistral | Thursday 30 August 2018 12:25:42 -0400 (0:00:01.856) 0:12:02.403 ******* >2018-08-30 12:25:42,652 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:42,674 p=14044 u=mistral | TASK [ceph-config : generate ceph configuration file: ceph.conf] *************** >2018-08-30 12:25:42,674 p=14044 u=mistral | Thursday 30 August 2018 12:25:42 -0400 (0:00:00.050) 0:12:02.453 ******* >2018-08-30 12:25:42,705 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:42,726 p=14044 u=mistral | TASK [ceph-config : create a local fetch directory if it does not exist] ******* >2018-08-30 12:25:42,726 p=14044 u=mistral | Thursday 30 August 2018 12:25:42 -0400 (0:00:00.051) 0:12:02.505 ******* >2018-08-30 12:25:42,770 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:42,791 p=14044 u=mistral | TASK [ceph-config : generate cluster uuid] ************************************* >2018-08-30 12:25:42,792 p=14044 u=mistral | Thursday 30 August 2018 12:25:42 -0400 (0:00:00.065) 0:12:02.571 ******* >2018-08-30 12:25:42,819 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:42,840 p=14044 u=mistral | TASK [ceph-config : read cluster uuid if it already exists] ******************** >2018-08-30 12:25:42,840 p=14044 u=mistral | Thursday 30 August 2018 12:25:42 -0400 (0:00:00.047) 0:12:02.619 ******* >2018-08-30 12:25:42,870 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:42,883 p=14044 u=mistral | TASK [ceph-config : ensure /etc/ceph exists] *********************************** >2018-08-30 12:25:42,883 p=14044 u=mistral | Thursday 30 August 2018 12:25:42 -0400 (0:00:00.043) 0:12:02.662 ******* >2018-08-30 12:25:43,484 p=14044 u=mistral | changed: [172.16.0.31] >2018-08-30 12:25:43,500 p=14044 u=mistral | TASK [ceph-config : generate ceph.conf configuration file] ********************* >2018-08-30 12:25:43,501 p=14044 u=mistral | Thursday 30 August 2018 12:25:43 -0400 (0:00:00.617) 0:12:03.280 ******* >2018-08-30 12:25:46,213 p=14044 u=mistral | changed: [172.16.0.31] >2018-08-30 12:25:46,225 p=14044 u=mistral | TASK [ceph-config : set fsid fact when generate_fsid = true] ******************* >2018-08-30 12:25:46,225 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:02.724) 0:12:06.004 ******* >2018-08-30 12:25:46,253 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:46,268 p=14044 u=mistral | TASK [ceph-client : copy ceph admin keyring when non containerized deployment] *** >2018-08-30 12:25:46,268 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:00.042) 0:12:06.047 ******* >2018-08-30 12:25:46,296 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:46,313 p=14044 u=mistral | TASK [ceph-client : set_fact keys_tmp - preserve backward compatibility after the introduction of the ceph_keys module] *** >2018-08-30 12:25:46,314 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:00.045) 0:12:06.093 ******* >2018-08-30 12:25:46,643 p=14044 u=mistral | ok: [172.16.0.31] => (item={u'mon_cap': u'profile rbd', u'name': u'client.openstack', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', u'osd_cap': u'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'}) >2018-08-30 12:25:46,673 p=14044 u=mistral | ok: [172.16.0.31] => (item={u'mon_cap': u'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"', u'mds_cap': u'allow *', u'name': u'client.manila', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', u'osd_cap': u'allow rw'}) >2018-08-30 12:25:46,708 p=14044 u=mistral | ok: [172.16.0.31] => (item={u'mon_cap': u'allow rw', u'name': u'client.radosgw', u'mgr_cap': u'allow *', u'mode': u'0600', u'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', u'osd_cap': u'allow rwx'}) >2018-08-30 12:25:46,724 p=14044 u=mistral | TASK [ceph-client : set_fact keys - override keys_tmp with keys] *************** >2018-08-30 12:25:46,724 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:00.410) 0:12:06.503 ******* >2018-08-30 12:25:46,792 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:46,807 p=14044 u=mistral | TASK [ceph-client : run a dummy container (sleep 300) from where we can create pool(s)/key(s)] *** >2018-08-30 12:25:46,807 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:00.082) 0:12:06.586 ******* >2018-08-30 12:25:46,838 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:46,852 p=14044 u=mistral | TASK [ceph-client : set_fact delegated_node] *********************************** >2018-08-30 12:25:46,852 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:00.044) 0:12:06.631 ******* >2018-08-30 12:25:46,912 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:46,926 p=14044 u=mistral | TASK [ceph-client : set_fact condition_copy_admin_key] ************************* >2018-08-30 12:25:46,927 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:00.074) 0:12:06.706 ******* >2018-08-30 12:25:46,983 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:46,997 p=14044 u=mistral | TASK [ceph-client : set_fact docker_exec_cmd] ********************************** >2018-08-30 12:25:46,997 p=14044 u=mistral | Thursday 30 August 2018 12:25:46 -0400 (0:00:00.070) 0:12:06.776 ******* >2018-08-30 12:25:47,083 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:47,113 p=14044 u=mistral | TASK [ceph-client : create cephx key(s)] *************************************** >2018-08-30 12:25:47,114 p=14044 u=mistral | Thursday 30 August 2018 12:25:47 -0400 (0:00:00.116) 0:12:06.893 ******* >2018-08-30 12:25:47,157 p=14044 u=mistral | skipping: [172.16.0.31] => (item={'caps': {'mds': u"''", 'osd': u"'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'", 'mon': u"'profile rbd'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:25:47,168 p=14044 u=mistral | skipping: [172.16.0.31] => (item={'caps': {'mds': u"'allow *'", 'osd': u"'allow rw'", 'mon': u'\'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"\'', 'mgr': u"'allow *'"}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:25:47,182 p=14044 u=mistral | skipping: [172.16.0.31] => (item={'caps': {'mds': u"''", 'osd': u"'allow rwx'", 'mon': u"'allow rw'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:25:47,212 p=14044 u=mistral | TASK [ceph-client : slurp client cephx key(s)] ********************************* >2018-08-30 12:25:47,212 p=14044 u=mistral | Thursday 30 August 2018 12:25:47 -0400 (0:00:00.098) 0:12:06.991 ******* >2018-08-30 12:25:47,252 p=14044 u=mistral | skipping: [172.16.0.31] => (item={'caps': {'mds': u"''", 'osd': u"'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'", 'mon': u"'profile rbd'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'name': u'client.openstack'}) >2018-08-30 12:25:47,264 p=14044 u=mistral | skipping: [172.16.0.31] => (item={'caps': {'mds': u"'allow *'", 'osd': u"'allow rw'", 'mon': u'\'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"\'', 'mgr': u"'allow *'"}, 'name': u'client.manila', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'mode': u'0600'}) >2018-08-30 12:25:47,276 p=14044 u=mistral | skipping: [172.16.0.31] => (item={'caps': {'mds': u"''", 'osd': u"'allow rwx'", 'mon': u"'allow rw'", 'mgr': u"'allow *'"}, 'mode': u'0600', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'name': u'client.radosgw'}) >2018-08-30 12:25:47,293 p=14044 u=mistral | TASK [ceph-client : list existing pool(s)] ************************************* >2018-08-30 12:25:47,293 p=14044 u=mistral | Thursday 30 August 2018 12:25:47 -0400 (0:00:00.080) 0:12:07.072 ******* >2018-08-30 12:25:47,342 p=14044 u=mistral | TASK [ceph-client : create ceph pool(s)] *************************************** >2018-08-30 12:25:47,342 p=14044 u=mistral | Thursday 30 August 2018 12:25:47 -0400 (0:00:00.049) 0:12:07.122 ******* >2018-08-30 12:25:47,382 p=14044 u=mistral | TASK [ceph-client : kill a dummy container that created pool(s)/key(s)] ******** >2018-08-30 12:25:47,383 p=14044 u=mistral | Thursday 30 August 2018 12:25:47 -0400 (0:00:00.040) 0:12:07.162 ******* >2018-08-30 12:25:47,414 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:47,427 p=14044 u=mistral | TASK [ceph-client : get client cephx keys] ************************************* >2018-08-30 12:25:47,427 p=14044 u=mistral | Thursday 30 August 2018 12:25:47 -0400 (0:00:00.044) 0:12:07.206 ******* >2018-08-30 12:25:48,289 p=14044 u=mistral | changed: [172.16.0.31] => (item={'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, u'encoding': u'base64', '_ansible_item_result': True, u'content': u'W2NsaWVudC5vcGVuc3RhY2tdCglrZXkgPSBBUUF0bFdOYkFBQUFBQkFBQ2pFMElvd1hvcFlLSmkrY3gwdTRQdz09CgljYXBzIG1kcyA9ICInJyIKCWNhcHMgbWdyID0gIidhbGxvdyAqJyIKCWNhcHMgbW9uID0gIidwcm9maWxlIHJiZCciCgljYXBzIG9zZCA9ICIncHJvZmlsZSByYmQgcG9vbD12b2x1bWVzLCBwcm9maWxlIHJiZCBwb29sPWJhY2t1cHMsIHByb2ZpbGUgcmJkIHBvb2w9dm1zLCBwcm9maWxlIHJiZCBwb29sPWltYWdlcywgcHJvZmlsZSByYmQgcG9vbD1tZXRyaWNzJyIK', 'failed': False, u'source': u'/etc/ceph/ceph.client.openstack.keyring', 'item': {'mode': u'0600', 'name': u'client.openstack', 'key': u'AQAtlWNbAAAAABAACjE0IowXopYKJi+cx0u4Pw==', 'caps': {'mds': u"''", 'osd': u"'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'", 'mgr': u"'allow *'", 'mon': u"'profile rbd'"}}, u'invocation': {u'module_args': {u'src': u'/etc/ceph/ceph.client.openstack.keyring'}}, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_ignore_errors': None}) >2018-08-30 12:25:49,015 p=14044 u=mistral | changed: [172.16.0.31] => (item={'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, u'encoding': u'base64', '_ansible_item_result': True, u'content': u'W2NsaWVudC5tYW5pbGFdCglrZXkgPSBBUUNROElkYkFBQUFBQkFBRWdkWG5kOUJISURJcmRjaldKOFZRdz09CgljYXBzIG1kcyA9ICInYWxsb3cgKiciCgljYXBzIG1nciA9ICInYWxsb3cgKiciCgljYXBzIG1vbiA9ICInYWxsb3cgciwgYWxsb3cgY29tbWFuZCBcImF1dGggZGVsXCIsIGFsbG93IGNvbW1hbmQgXCJhdXRoIGNhcHNcIiwgYWxsb3cgY29tbWFuZCBcImF1dGggZ2V0XCIsIGFsbG93IGNvbW1hbmQgXCJhdXRoIGdldC1vci1jcmVhdGVcIiciCgljYXBzIG9zZCA9ICInYWxsb3cgcncnIgo=', 'failed': False, u'source': u'/etc/ceph/ceph.client.manila.keyring', 'item': {'name': u'client.manila', 'mode': u'0600', 'key': u'AQCQ8IdbAAAAABAAEgdXnd9BHIDIrdcjWJ8VQw==', 'caps': {'mds': u"'allow *'", 'osd': u"'allow rw'", 'mgr': u"'allow *'", 'mon': u'\'allow r, allow command \\"auth del\\", allow command \\"auth caps\\", allow command \\"auth get\\", allow command \\"auth get-or-create\\"\''}}, u'invocation': {u'module_args': {u'src': u'/etc/ceph/ceph.client.manila.keyring'}}, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_ignore_errors': None}) >2018-08-30 12:25:49,995 p=14044 u=mistral | changed: [172.16.0.31] => (item={'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, u'encoding': u'base64', '_ansible_item_result': True, u'content': u'W2NsaWVudC5yYWRvc2d3XQoJa2V5ID0gQVFBdGxXTmJBQUFBQUJBQVBRS0prcmNYZzB5c0duVHhBOGRzZ0E9PQoJY2FwcyBtZHMgPSAiJyciCgljYXBzIG1nciA9ICInYWxsb3cgKiciCgljYXBzIG1vbiA9ICInYWxsb3cgcncnIgoJY2FwcyBvc2QgPSAiJ2FsbG93IHJ3eCciCg==', 'failed': False, u'source': u'/etc/ceph/ceph.client.radosgw.keyring', 'item': {'mode': u'0600', 'name': u'client.radosgw', 'key': u'AQAtlWNbAAAAABAAPQKJkrcXg0ysGnTxA8dsgA==', 'caps': {'mds': u"''", 'osd': u"'allow rwx'", 'mgr': u"'allow *'", 'mon': u"'allow rw'"}}, u'invocation': {u'module_args': {u'src': u'/etc/ceph/ceph.client.radosgw.keyring'}}, '_ansible_delegated_vars': {'ansible_delegated_host': u'172.16.0.33', 'ansible_host': u'172.16.0.33'}, '_ansible_ignore_errors': None}) >2018-08-30 12:25:49,999 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called before restart] ******* >2018-08-30 12:25:49,999 p=14044 u=mistral | Thursday 30 August 2018 12:25:49 -0400 (0:00:02.572) 0:12:09.778 ******* >2018-08-30 12:25:50,064 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:50,064 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mon restart script] ********************** >2018-08-30 12:25:50,065 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.065) 0:12:09.844 ******* >2018-08-30 12:25:50,110 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:50,111 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - non container] *** >2018-08-30 12:25:50,112 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.046) 0:12:09.891 ******* >2018-08-30 12:25:50,215 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.33) >2018-08-30 12:25:50,221 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.24) >2018-08-30 12:25:50,231 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.25) >2018-08-30 12:25:50,233 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mon daemon(s) - container] ******* >2018-08-30 12:25:50,233 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.121) 0:12:10.012 ******* >2018-08-30 12:25:50,316 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.33) >2018-08-30 12:25:50,323 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.24) >2018-08-30 12:25:50,328 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.25) >2018-08-30 12:25:50,330 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mon_handler_called after restart] ******** >2018-08-30 12:25:50,330 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.097) 0:12:10.109 ******* >2018-08-30 12:25:50,394 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:50,395 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called before restart] ******* >2018-08-30 12:25:50,395 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.064) 0:12:10.174 ******* >2018-08-30 12:25:50,456 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:50,457 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy osd restart script] ********************** >2018-08-30 12:25:50,458 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.062) 0:12:10.237 ******* >2018-08-30 12:25:50,500 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:50,501 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - non container] *** >2018-08-30 12:25:50,501 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.043) 0:12:10.280 ******* >2018-08-30 12:25:50,585 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.28) >2018-08-30 12:25:50,589 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.36) >2018-08-30 12:25:50,594 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.32) >2018-08-30 12:25:50,596 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph osds daemon(s) - container] ****** >2018-08-30 12:25:50,596 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.095) 0:12:10.375 ******* >2018-08-30 12:25:50,682 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.28) >2018-08-30 12:25:50,689 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.36) >2018-08-30 12:25:50,695 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.32) >2018-08-30 12:25:50,697 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _osd_handler_called after restart] ******** >2018-08-30 12:25:50,697 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.101) 0:12:10.476 ******* >2018-08-30 12:25:50,996 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:50,997 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called before restart] ******* >2018-08-30 12:25:50,997 p=14044 u=mistral | Thursday 30 August 2018 12:25:50 -0400 (0:00:00.299) 0:12:10.777 ******* >2018-08-30 12:25:51,329 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:51,330 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mds restart script] ********************** >2018-08-30 12:25:51,331 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.333) 0:12:11.110 ******* >2018-08-30 12:25:51,370 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:51,370 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - non container] *** >2018-08-30 12:25:51,371 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.039) 0:12:11.150 ******* >2018-08-30 12:25:51,413 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mds daemon(s) - container] ******* >2018-08-30 12:25:51,414 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.043) 0:12:11.193 ******* >2018-08-30 12:25:51,457 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mds_handler_called after restart] ******** >2018-08-30 12:25:51,458 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.043) 0:12:11.237 ******* >2018-08-30 12:25:51,789 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:51,790 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called before restart] ******* >2018-08-30 12:25:51,791 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.332) 0:12:11.570 ******* >2018-08-30 12:25:51,853 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:51,854 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rgw restart script] ********************** >2018-08-30 12:25:51,854 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.063) 0:12:11.633 ******* >2018-08-30 12:25:51,894 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:51,895 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - non container] *** >2018-08-30 12:25:51,895 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.041) 0:12:11.675 ******* >2018-08-30 12:25:51,938 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rgw daemon(s) - container] ******* >2018-08-30 12:25:51,939 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.043) 0:12:11.718 ******* >2018-08-30 12:25:51,985 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rgw_handler_called after restart] ******** >2018-08-30 12:25:51,986 p=14044 u=mistral | Thursday 30 August 2018 12:25:51 -0400 (0:00:00.046) 0:12:11.765 ******* >2018-08-30 12:25:52,051 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:52,052 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called before restart] *** >2018-08-30 12:25:52,052 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.066) 0:12:11.831 ******* >2018-08-30 12:25:52,117 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:52,118 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy rbd mirror restart script] *************** >2018-08-30 12:25:52,118 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.065) 0:12:11.897 ******* >2018-08-30 12:25:52,157 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:52,158 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - non container] *** >2018-08-30 12:25:52,159 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.040) 0:12:11.938 ******* >2018-08-30 12:25:52,199 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph rbd mirror daemon(s) - container] *** >2018-08-30 12:25:52,200 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.041) 0:12:11.979 ******* >2018-08-30 12:25:52,242 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _rbdmirror_handler_called after restart] *** >2018-08-30 12:25:52,242 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.042) 0:12:12.022 ******* >2018-08-30 12:25:52,310 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:52,311 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called before restart] ******* >2018-08-30 12:25:52,311 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.068) 0:12:12.090 ******* >2018-08-30 12:25:52,372 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:52,373 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : copy mgr restart script] ********************** >2018-08-30 12:25:52,373 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.061) 0:12:12.152 ******* >2018-08-30 12:25:52,413 p=14044 u=mistral | skipping: [172.16.0.31] >2018-08-30 12:25:52,413 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - non container] *** >2018-08-30 12:25:52,414 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.040) 0:12:12.193 ******* >2018-08-30 12:25:52,502 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.33) >2018-08-30 12:25:52,509 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.24) >2018-08-30 12:25:52,516 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.25) >2018-08-30 12:25:52,517 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : restart ceph mgr daemon(s) - container] ******* >2018-08-30 12:25:52,518 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.103) 0:12:12.297 ******* >2018-08-30 12:25:52,607 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.33) >2018-08-30 12:25:52,612 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.24) >2018-08-30 12:25:52,618 p=14044 u=mistral | skipping: [172.16.0.31] => (item=172.16.0.25) >2018-08-30 12:25:52,619 p=14044 u=mistral | RUNNING HANDLER [ceph-defaults : set _mgr_handler_called after restart] ******** >2018-08-30 12:25:52,620 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.102) 0:12:12.399 ******* >2018-08-30 12:25:52,689 p=14044 u=mistral | ok: [172.16.0.31] >2018-08-30 12:25:52,709 p=14044 u=mistral | PLAY [show ceph status] ******************************************************** >2018-08-30 12:25:52,750 p=14044 u=mistral | TASK [ceph-defaults : check for a mon container] ******************************* >2018-08-30 12:25:52,751 p=14044 u=mistral | Thursday 30 August 2018 12:25:52 -0400 (0:00:00.130) 0:12:12.530 ******* >2018-08-30 12:25:53,459 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:25:53,523 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:25:53,545 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:25:53,561 p=14044 u=mistral | TASK [ceph-defaults : check for an osd container] ****************************** >2018-08-30 12:25:53,561 p=14044 u=mistral | Thursday 30 August 2018 12:25:53 -0400 (0:00:00.810) 0:12:13.340 ******* >2018-08-30 12:25:53,616 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:53,617 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:53,637 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:53,651 p=14044 u=mistral | TASK [ceph-defaults : check for a mds container] ******************************* >2018-08-30 12:25:53,651 p=14044 u=mistral | Thursday 30 August 2018 12:25:53 -0400 (0:00:00.089) 0:12:13.430 ******* >2018-08-30 12:25:53,704 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:53,707 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:53,724 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:53,751 p=14044 u=mistral | TASK [ceph-defaults : check for a rgw container] ******************************* >2018-08-30 12:25:53,751 p=14044 u=mistral | Thursday 30 August 2018 12:25:53 -0400 (0:00:00.100) 0:12:13.530 ******* >2018-08-30 12:25:53,789 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:53,822 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:53,853 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:53,869 p=14044 u=mistral | TASK [ceph-defaults : check for a mgr container] ******************************* >2018-08-30 12:25:53,869 p=14044 u=mistral | Thursday 30 August 2018 12:25:53 -0400 (0:00:00.117) 0:12:13.648 ******* >2018-08-30 12:25:54,509 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:25:54,565 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:25:54,621 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:25:54,636 p=14044 u=mistral | TASK [ceph-defaults : check for a rbd mirror container] ************************ >2018-08-30 12:25:54,636 p=14044 u=mistral | Thursday 30 August 2018 12:25:54 -0400 (0:00:00.767) 0:12:14.415 ******* >2018-08-30 12:25:54,689 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:54,692 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:54,710 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:54,723 p=14044 u=mistral | TASK [ceph-defaults : check for a nfs container] ******************************* >2018-08-30 12:25:54,724 p=14044 u=mistral | Thursday 30 August 2018 12:25:54 -0400 (0:00:00.087) 0:12:14.503 ******* >2018-08-30 12:25:54,787 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:54,788 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:54,804 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:54,819 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mon socket] ***************************** >2018-08-30 12:25:54,820 p=14044 u=mistral | Thursday 30 August 2018 12:25:54 -0400 (0:00:00.096) 0:12:14.599 ******* >2018-08-30 12:25:54,855 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:54,883 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:54,904 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:54,918 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mon socket is in-use] ****************** >2018-08-30 12:25:54,918 p=14044 u=mistral | Thursday 30 August 2018 12:25:54 -0400 (0:00:00.098) 0:12:14.697 ******* >2018-08-30 12:25:54,968 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:54,970 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:54,993 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,006 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mon socket if exists and not used by a process] *** >2018-08-30 12:25:55,007 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.088) 0:12:14.786 ******* >2018-08-30 12:25:55,036 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,062 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,084 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,098 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph osd socket] ***************************** >2018-08-30 12:25:55,099 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.091) 0:12:14.878 ******* >2018-08-30 12:25:55,153 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,155 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,174 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,189 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph osd socket is in-use] ****************** >2018-08-30 12:25:55,189 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.090) 0:12:14.968 ******* >2018-08-30 12:25:55,223 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,246 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,270 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,285 p=14044 u=mistral | TASK [ceph-defaults : remove ceph osd socket if exists and not used by a process] *** >2018-08-30 12:25:55,286 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.096) 0:12:15.065 ******* >2018-08-30 12:25:55,344 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,345 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,365 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,380 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mds socket] ***************************** >2018-08-30 12:25:55,380 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.094) 0:12:15.160 ******* >2018-08-30 12:25:55,452 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,454 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,471 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,494 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mds socket is in-use] ****************** >2018-08-30 12:25:55,494 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.113) 0:12:15.274 ******* >2018-08-30 12:25:55,531 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,558 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,577 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,595 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mds socket if exists and not used by a process] *** >2018-08-30 12:25:55,596 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.101) 0:12:15.375 ******* >2018-08-30 12:25:55,669 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,671 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,695 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,710 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rgw socket] ***************************** >2018-08-30 12:25:55,711 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.115) 0:12:15.490 ******* >2018-08-30 12:25:55,776 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,779 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,799 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,814 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rgw socket is in-use] ****************** >2018-08-30 12:25:55,814 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.103) 0:12:15.594 ******* >2018-08-30 12:25:55,879 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,880 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:55,901 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:55,916 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rgw socket if exists and not used by a process] *** >2018-08-30 12:25:55,916 p=14044 u=mistral | Thursday 30 August 2018 12:25:55 -0400 (0:00:00.101) 0:12:15.696 ******* >2018-08-30 12:25:55,981 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:55,983 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,000 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,014 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph mgr socket] ***************************** >2018-08-30 12:25:56,014 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.097) 0:12:15.793 ******* >2018-08-30 12:25:56,069 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,071 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,097 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,112 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph mgr socket is in-use] ****************** >2018-08-30 12:25:56,112 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.097) 0:12:15.891 ******* >2018-08-30 12:25:56,170 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,172 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,188 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,202 p=14044 u=mistral | TASK [ceph-defaults : remove ceph mgr socket if exists and not used by a process] *** >2018-08-30 12:25:56,202 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.090) 0:12:15.982 ******* >2018-08-30 12:25:56,257 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,259 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,278 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,296 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph rbd mirror socket] ********************** >2018-08-30 12:25:56,297 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.094) 0:12:16.076 ******* >2018-08-30 12:25:56,362 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,364 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,384 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,406 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph rbd mirror socket is in-use] *********** >2018-08-30 12:25:56,406 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.109) 0:12:16.185 ******* >2018-08-30 12:25:56,443 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,472 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,501 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,518 p=14044 u=mistral | TASK [ceph-defaults : remove ceph rbd mirror socket if exists and not used by a process] *** >2018-08-30 12:25:56,518 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.112) 0:12:16.298 ******* >2018-08-30 12:25:56,590 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,591 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,612 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,630 p=14044 u=mistral | TASK [ceph-defaults : check for a ceph nfs ganesha socket] ********************* >2018-08-30 12:25:56,631 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.112) 0:12:16.410 ******* >2018-08-30 12:25:56,674 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,705 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,723 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,738 p=14044 u=mistral | TASK [ceph-defaults : check if the ceph nfs ganesha socket is in-use] ********** >2018-08-30 12:25:56,738 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.107) 0:12:16.517 ******* >2018-08-30 12:25:56,771 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,797 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,819 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,833 p=14044 u=mistral | TASK [ceph-defaults : remove ceph nfs ganesha socket if exists and not used by a process] *** >2018-08-30 12:25:56,833 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.095) 0:12:16.613 ******* >2018-08-30 12:25:56,890 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:56,891 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:56,907 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:56,921 p=14044 u=mistral | TASK [ceph-defaults : check if it is atomic host] ****************************** >2018-08-30 12:25:56,921 p=14044 u=mistral | Thursday 30 August 2018 12:25:56 -0400 (0:00:00.087) 0:12:16.701 ******* >2018-08-30 12:25:57,527 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:25:57,568 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:25:57,574 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:25:57,590 p=14044 u=mistral | TASK [ceph-defaults : set_fact is_atomic] ************************************** >2018-08-30 12:25:57,591 p=14044 u=mistral | Thursday 30 August 2018 12:25:57 -0400 (0:00:00.669) 0:12:17.370 ******* >2018-08-30 12:25:57,936 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:25:57,941 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:25:57,984 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:25:57,997 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_hostname] ****************** >2018-08-30 12:25:57,998 p=14044 u=mistral | Thursday 30 August 2018 12:25:57 -0400 (0:00:00.406) 0:12:17.777 ******* >2018-08-30 12:25:58,341 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:25:58,372 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:25:58,394 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:25:58,409 p=14044 u=mistral | TASK [ceph-defaults : set_fact monitor_name ansible_fqdn] ********************** >2018-08-30 12:25:58,409 p=14044 u=mistral | Thursday 30 August 2018 12:25:58 -0400 (0:00:00.411) 0:12:18.188 ******* >2018-08-30 12:25:58,441 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:58,467 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:25:58,482 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:25:58,510 p=14044 u=mistral | TASK [ceph-defaults : set_fact docker_exec_cmd] ******************************** >2018-08-30 12:25:58,510 p=14044 u=mistral | Thursday 30 August 2018 12:25:58 -0400 (0:00:00.100) 0:12:18.289 ******* >2018-08-30 12:25:58,915 p=14044 u=mistral | ok: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:25:58,963 p=14044 u=mistral | ok: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:25:58,981 p=14044 u=mistral | ok: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:25:59,010 p=14044 u=mistral | TASK [ceph-defaults : is ceph running already?] ******************************** >2018-08-30 12:25:59,010 p=14044 u=mistral | Thursday 30 August 2018 12:25:59 -0400 (0:00:00.500) 0:12:18.789 ******* >2018-08-30 12:25:59,040 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:25:59,072 p=14044 u=mistral | TASK [ceph-defaults : check if /tmp/file-mistral-actionLfF8RH directory exists] *** >2018-08-30 12:25:59,073 p=14044 u=mistral | Thursday 30 August 2018 12:25:59 -0400 (0:00:00.062) 0:12:18.852 ******* >2018-08-30 12:25:59,550 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:25:59,563 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_current_fsid rc 1] ************************* >2018-08-30 12:25:59,563 p=14044 u=mistral | Thursday 30 August 2018 12:25:59 -0400 (0:00:00.490) 0:12:19.342 ******* >2018-08-30 12:25:59,899 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:25:59,911 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:25:59,969 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:25:59,992 p=14044 u=mistral | TASK [ceph-defaults : create a local fetch directory if it does not exist] ***** >2018-08-30 12:25:59,992 p=14044 u=mistral | Thursday 30 August 2018 12:25:59 -0400 (0:00:00.428) 0:12:19.771 ******* >2018-08-30 12:26:00,247 p=14044 u=mistral | ok: [172.16.0.33 -> localhost] >2018-08-30 12:26:00,284 p=14044 u=mistral | ok: [172.16.0.24 -> localhost] >2018-08-30 12:26:00,325 p=14044 u=mistral | ok: [172.16.0.25 -> localhost] >2018-08-30 12:26:00,341 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid ceph_current_fsid.stdout] ****************** >2018-08-30 12:26:00,341 p=14044 u=mistral | Thursday 30 August 2018 12:26:00 -0400 (0:00:00.348) 0:12:20.120 ******* >2018-08-30 12:26:00,373 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:00,397 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:00,417 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:00,431 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_release ceph_stable_release] *************** >2018-08-30 12:26:00,432 p=14044 u=mistral | Thursday 30 August 2018 12:26:00 -0400 (0:00:00.090) 0:12:20.211 ******* >2018-08-30 12:26:00,758 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:26:00,792 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:26:00,839 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:26:00,866 p=14044 u=mistral | TASK [ceph-defaults : generate cluster fsid] *********************************** >2018-08-30 12:26:00,867 p=14044 u=mistral | Thursday 30 August 2018 12:26:00 -0400 (0:00:00.435) 0:12:20.646 ******* >2018-08-30 12:26:00,905 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:00,940 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:00,960 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:00,980 p=14044 u=mistral | TASK [ceph-defaults : reuse cluster fsid when cluster is already running] ****** >2018-08-30 12:26:00,980 p=14044 u=mistral | Thursday 30 August 2018 12:26:00 -0400 (0:00:00.113) 0:12:20.759 ******* >2018-08-30 12:26:01,021 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:01,052 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:01,076 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:01,096 p=14044 u=mistral | TASK [ceph-defaults : read cluster fsid if it already exists] ****************** >2018-08-30 12:26:01,096 p=14044 u=mistral | Thursday 30 August 2018 12:26:01 -0400 (0:00:00.116) 0:12:20.876 ******* >2018-08-30 12:26:01,133 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:01,168 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:01,183 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:01,198 p=14044 u=mistral | TASK [ceph-defaults : set_fact fsid] ******************************************* >2018-08-30 12:26:01,198 p=14044 u=mistral | Thursday 30 August 2018 12:26:01 -0400 (0:00:00.101) 0:12:20.977 ******* >2018-08-30 12:26:01,233 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:01,259 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:01,272 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:01,286 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_hostname] ********************** >2018-08-30 12:26:01,287 p=14044 u=mistral | Thursday 30 August 2018 12:26:01 -0400 (0:00:00.088) 0:12:21.066 ******* >2018-08-30 12:26:01,631 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:26:01,658 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:26:01,680 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:26:01,693 p=14044 u=mistral | TASK [ceph-defaults : set_fact mds_name ansible_fqdn] ************************** >2018-08-30 12:26:01,694 p=14044 u=mistral | Thursday 30 August 2018 12:26:01 -0400 (0:00:00.406) 0:12:21.473 ******* >2018-08-30 12:26:01,722 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:01,746 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:01,760 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:01,774 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_owner ceph] **************** >2018-08-30 12:26:01,774 p=14044 u=mistral | Thursday 30 August 2018 12:26:01 -0400 (0:00:00.080) 0:12:21.554 ******* >2018-08-30 12:26:01,806 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:01,835 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:01,851 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:01,869 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_group rbd_client_directory_group] *** >2018-08-30 12:26:01,870 p=14044 u=mistral | Thursday 30 August 2018 12:26:01 -0400 (0:00:00.095) 0:12:21.649 ******* >2018-08-30 12:26:01,907 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:01,933 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:01,959 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:01,973 p=14044 u=mistral | TASK [ceph-defaults : set_fact rbd_client_directory_mode 0770] ***************** >2018-08-30 12:26:01,974 p=14044 u=mistral | Thursday 30 August 2018 12:26:01 -0400 (0:00:00.104) 0:12:21.753 ******* >2018-08-30 12:26:02,033 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:02,034 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:02,057 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:02,070 p=14044 u=mistral | TASK [ceph-defaults : resolve device link(s)] ********************************** >2018-08-30 12:26:02,071 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.096) 0:12:21.850 ******* >2018-08-30 12:26:02,127 p=14044 u=mistral | skipping: [172.16.0.33] => (item=/dev/vdb) >2018-08-30 12:26:02,130 p=14044 u=mistral | skipping: [172.16.0.24] => (item=/dev/vdb) >2018-08-30 12:26:02,153 p=14044 u=mistral | skipping: [172.16.0.25] => (item=/dev/vdb) >2018-08-30 12:26:02,168 p=14044 u=mistral | TASK [ceph-defaults : set_fact build devices from resolved symlinks] *********** >2018-08-30 12:26:02,168 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.097) 0:12:21.948 ******* >2018-08-30 12:26:02,224 p=14044 u=mistral | skipping: [172.16.0.33] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:26:02,230 p=14044 u=mistral | skipping: [172.16.0.24] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:26:02,256 p=14044 u=mistral | skipping: [172.16.0.25] => (item={'skipped': True, '_ansible_no_log': False, 'skip_reason': u'Conditional result was False', '_ansible_item_result': True, 'item': u'/dev/vdb', 'changed': False, '_ansible_ignore_errors': None}) >2018-08-30 12:26:02,272 p=14044 u=mistral | TASK [ceph-defaults : set_fact build final devices list] *********************** >2018-08-30 12:26:02,272 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.103) 0:12:22.051 ******* >2018-08-30 12:26:02,308 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:02,337 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:02,356 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:02,371 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - non container] *** >2018-08-30 12:26:02,371 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.098) 0:12:22.150 ******* >2018-08-30 12:26:02,427 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:02,428 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:02,447 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:02,462 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - non container] *** >2018-08-30 12:26:02,462 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.091) 0:12:22.241 ******* >2018-08-30 12:26:02,520 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:02,521 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:02,538 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:02,553 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for debian based system - container] *** >2018-08-30 12:26:02,554 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.091) 0:12:22.333 ******* >2018-08-30 12:26:02,613 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:02,615 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:02,635 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:02,657 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat based system - container] *** >2018-08-30 12:26:02,658 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.104) 0:12:22.437 ******* >2018-08-30 12:26:02,718 p=14044 u=mistral | skipping: [172.16.0.33] >2018-08-30 12:26:02,726 p=14044 u=mistral | skipping: [172.16.0.24] >2018-08-30 12:26:02,741 p=14044 u=mistral | skipping: [172.16.0.25] >2018-08-30 12:26:02,755 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_uid for red hat] *************************** >2018-08-30 12:26:02,755 p=14044 u=mistral | Thursday 30 August 2018 12:26:02 -0400 (0:00:00.097) 0:12:22.535 ******* >2018-08-30 12:26:03,132 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:26:03,135 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:26:03,174 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:26:03,192 p=14044 u=mistral | TASK [ceph-defaults : set_fact ceph_directories] ******************************* >2018-08-30 12:26:03,192 p=14044 u=mistral | Thursday 30 August 2018 12:26:03 -0400 (0:00:00.436) 0:12:22.971 ******* >2018-08-30 12:26:03,527 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:26:03,562 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:26:03,602 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:26:03,619 p=14044 u=mistral | TASK [ceph-defaults : create ceph initial directories] ************************* >2018-08-30 12:26:03,619 p=14044 u=mistral | Thursday 30 August 2018 12:26:03 -0400 (0:00:00.427) 0:12:23.398 ******* >2018-08-30 12:26:04,238 p=14044 u=mistral | ok: [172.16.0.33] => (item=/etc/ceph) >2018-08-30 12:26:04,295 p=14044 u=mistral | ok: [172.16.0.24] => (item=/etc/ceph) >2018-08-30 12:26:04,329 p=14044 u=mistral | ok: [172.16.0.25] => (item=/etc/ceph) >2018-08-30 12:26:04,690 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/) >2018-08-30 12:26:04,691 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/) >2018-08-30 12:26:04,692 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/) >2018-08-30 12:26:04,848 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mon) >2018-08-30 12:26:04,966 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mon) >2018-08-30 12:26:04,971 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mon) >2018-08-30 12:26:05,151 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/osd) >2018-08-30 12:26:05,275 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/osd) >2018-08-30 12:26:05,287 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/osd) >2018-08-30 12:26:05,462 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/mds) >2018-08-30 12:26:05,574 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/mds) >2018-08-30 12:26:05,587 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/mds) >2018-08-30 12:26:05,766 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/tmp) >2018-08-30 12:26:05,872 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/tmp) >2018-08-30 12:26:05,929 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/tmp) >2018-08-30 12:26:06,095 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:26:06,221 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:26:06,254 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/radosgw) >2018-08-30 12:26:06,413 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:26:06,517 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:26:06,553 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rgw) >2018-08-30 12:26:06,714 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:26:06,818 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:26:06,841 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-mds) >2018-08-30 12:26:07,006 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:26:07,105 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:26:07,142 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-osd) >2018-08-30 12:26:07,303 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:26:07,420 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:26:07,422 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/lib/ceph/bootstrap-rbd) >2018-08-30 12:26:07,577 p=14044 u=mistral | ok: [172.16.0.33] => (item=/var/run/ceph) >2018-08-30 12:26:07,699 p=14044 u=mistral | ok: [172.16.0.24] => (item=/var/run/ceph) >2018-08-30 12:26:07,701 p=14044 u=mistral | ok: [172.16.0.25] => (item=/var/run/ceph) >2018-08-30 12:26:07,737 p=14044 u=mistral | TASK [set_fact docker_exec_cmd_status] ***************************************** >2018-08-30 12:26:07,738 p=14044 u=mistral | Thursday 30 August 2018 12:26:07 -0400 (0:00:04.118) 0:12:27.517 ******* >2018-08-30 12:26:07,842 p=14044 u=mistral | ok: [172.16.0.33] >2018-08-30 12:26:07,867 p=14044 u=mistral | ok: [172.16.0.24] >2018-08-30 12:26:07,895 p=14044 u=mistral | ok: [172.16.0.25] >2018-08-30 12:26:07,923 p=14044 u=mistral | TASK [show ceph status] ******************************************************** >2018-08-30 12:26:07,923 p=14044 u=mistral | Thursday 30 August 2018 12:26:07 -0400 (0:00:00.185) 0:12:27.702 ******* >2018-08-30 12:26:08,882 p=14044 u=mistral | changed: [172.16.0.33 -> 172.16.0.33] >2018-08-30 12:26:08,923 p=14044 u=mistral | changed: [172.16.0.24 -> 172.16.0.33] >2018-08-30 12:26:09,003 p=14044 u=mistral | changed: [172.16.0.25 -> 172.16.0.33] >2018-08-30 12:26:09,007 p=14044 u=mistral | PLAY RECAP ********************************************************************* >2018-08-30 12:26:09,007 p=14044 u=mistral | 172.16.0.22 : ok=53 changed=7 unreachable=0 failed=0 >2018-08-30 12:26:09,007 p=14044 u=mistral | 172.16.0.24 : ok=156 changed=21 unreachable=0 failed=0 >2018-08-30 12:26:09,007 p=14044 u=mistral | 172.16.0.25 : ok=156 changed=21 unreachable=0 failed=0 >2018-08-30 12:26:09,007 p=14044 u=mistral | 172.16.0.28 : ok=75 changed=9 unreachable=0 failed=0 >2018-08-30 12:26:09,008 p=14044 u=mistral | 172.16.0.31 : ok=49 changed=6 unreachable=0 failed=0 >2018-08-30 12:26:09,008 p=14044 u=mistral | 172.16.0.32 : ok=81 changed=12 unreachable=0 failed=0 >2018-08-30 12:26:09,008 p=14044 u=mistral | 172.16.0.33 : ok=159 changed=21 unreachable=0 failed=0 >2018-08-30 12:26:09,008 p=14044 u=mistral | 172.16.0.36 : ok=75 changed=9 unreachable=0 failed=0 >2018-08-30 12:26:09,008 p=14044 u=mistral | localhost : ok=1 changed=0 unreachable=0 failed=0 >2018-08-30 12:26:09,009 p=14044 u=mistral | Thursday 30 August 2018 12:26:09 -0400 (0:00:01.085) 0:12:28.788 ******* >2018-08-30 12:26:09,009 p=14044 u=mistral | ===============================================================================
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1624341
:
1480063
| 1480065 |
1480066