Created attachment 1436089 [details]
journalctl logs and ceph-osd status

Description of problem:

CU asked us to investigate issue with his RHOSP12 + ceph environment. He reported the following issue: all ceph-disk@dev-sdXX.service units are in failed state.

I have tried to troubleshoot the issue for one specific ceph disk sdv (but the picture is the same for other ones). Please find the extract from journalctl logs and ``systemctl status --all`` command in attachments (to keep description shorter).

It looks like the following ceph-ansible v3.0.27 play masked all ceph-osd@N.service services and broken ceph-disk systemd units:

    - name: stop non-containerized ceph osd(s)
      systemd:
        name: "{{ item }}"
        state: stopped
        enabled: no
        masked: yes
      with_items: "{{ running_osds.stdout_lines | default([])}}"
      when: running_osds != []


I may be wrong with the clue above, but customers are still struggling, so please find additional information about customer's environment in comment #1.

Customer said that his ceph environment is running fine, but he is worried about failed systemd units. Please feel free to adjust severity if this problem is cosmetic.