Description of problem:
Overcloud deployment using external Ceph cluster fails with:

  status: CREATE_FAILED
  status_reason: |
    Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
  deploy_stdout: |
    Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend
  deploy_stderr: |
    exception: connect failed
    Warning: This method is deprecated, please use match expressions with Stdlib::Compat::Array instead. They are described at https://docs.puppet.com/puppet/latest/reference/lang_data_type.html#match-expressions. at ["/var/lib/heat-config/heat-config-puppet/1e47f108-e17d-4966-8e45-b5ffd908c09d.pp", 33]:["/etc/puppet/modules/tripleo/manifests/profile/base/ceph/client.pp", 29]
       (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation')
    Warning: ModuleLoader: module 'ceph' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules
       (file & line not available)
    Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Hash. There is further documentation for validate_legacy function in the README. at ["/var/lib/heat-config/heat-config-puppet/1e47f108-e17d-4966-8e45-b5ffd908c09d.pp", 33]:["/etc/puppet/modules/tripleo/manifests/profile/base/ceph/client.pp", 29]
       (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation')
    Error: Evaluation Error: Error while evaluating a Function Call, "{ client.openstack: { secret: 'AQDU2odYsbj/BBAAf3qyWzBj0ZKyOiWKI4vOCQ==', mode: '0644', cap_mon: 'allow r', cap_osd: 'allow class-read object_prefix rbd_children, allow rwx pool=volumes, allow rwx pool=backups, allow rwx pool=vms, allow rwx pool=images, allow rwx pool=metrics' } }" is not a Hash.  It looks to be a String at /etc/puppet/modules/ceph/manifests/profile/params.pp:239:3 on node overcloud-serviceapi-0.localdomain

Version-Release number of selected component (if applicable):
openstack-tripleo-heat-templates-6.0.0-0.20170120220933.36d493c.el7ost.noarch
puppet-ceph-2.2.1-0.20170116235834.8e01a41.el7ost.noarch

How reproducible:
one time

Steps to Reproduce:
1. Deploy overcloud with custom roles and using an external Ceph cluster

Actual results:
Deployment fails

Expected results:
Deployment is successful.

Additional info:
Deploy command:
source ~/stackrc
export THT=/usr/share/openstack-tripleo-heat-templates/

openstack overcloud deploy --templates $THT \
-r ~/openstack_deployment/roles/roles_data.yaml \
-e $THT/environments/puppet-pacemaker.yaml \
-e $THT/environments/network-isolation.yaml \
-e $THT/environments/network-management.yaml \
-e $THT/environments/storage-environment.yaml \
-e $THT/environments/puppet-ceph-external.yaml \
-e ~/openstack_deployment/environments/nodes.yaml \
-e ~/openstack_deployment/environments/network-environment.yaml \
-e ~/openstack_deployment/environments/disk-layout.yaml \
-e ~/openstack_deployment/environments/neutron-settings.yaml \
-e ~/openstack_deployment/environments/external-ceph.yaml \
--log-file overcloud_deployment.log &> overcloud_install.log

/home/stack/openstack_deployment/environments/external-ceph.yaml
parameter_defaults:
  # NOTE: These example parameters are required when using CephExternal
  CephClusterFSID: '03eba0bd-8a3c-4dfb-91cb-1348fd7a1e66'
  CephClientKey: 'AQDU2odYsbj/BBAAf3qyWzBj0ZKyOiWKI4vOCQ=='
  CephExternalMonHost: '10.0.0.250'

roles_data.yaml:
http://paste.openstack.org/show/596407/