Description of problem:  When installing a rgw in ceph-ansible 4.1 (4.0.23) there is no way to specify a crush-rule-set


Version-Release number of selected component (if applicable):


How reproducible: every timne


Steps to Reproduce:
1. have tiered storage 
2. install rgw 
3.  rgw goes to default crush rule / cannot set custom crush-rule-set

Actual results:

default rule-set

Expected results:

I can set my own from my crush rule set 

Additional info:

FIX:

Modify the following file: roles/ceph-rgw/tasks/rgw_create_pools.yml 

to have the following:  (adding {{ item.value.crushname | default('') }} ) 

. - name: create replicated pools for rgw
  command: "{{ container_exec_cmd }} ceph --connect-timeout 10 --cluster {{ cluster }} osd pool create {{ item.key }} {{ item.value.pg_num | default(osd_pool_default_pg_num) }} replicated {{ item.value.crushname | default('') }}"

also need to update group_vars/rgws.yml to the following 

#rgw_create_pools:
#  "{{ rgw_zone }}.rgw.buckets.data":
#    pg_num: 64
#    type: ec
#    ec_profile: myecprofile
#    ec_k: 5
#    ec_m: 3
#  "{{ rgw_zone }}.rgw.buckets.index":
#    pg_num: 16
#    size: 3
#    type: replicated
#    crushname:
#  "{{ rgw_zone }}.rgw.meta":
#    pg_num: 8
#    size: 3
#    type: replicated
#    crushname:
#  "{{ rgw_zone }}.rgw.log":
#    pg_num: 8
#    size: 3
#    type: replicated
#    crushname:
#  "{{ rgw_zone }}.rgw.control":
#    pg_num: 8
#    size: 3
#    type: replicated
#    crushname: