Created attachment 1820118 [details]
rook log

Description of problem (please be detailed as possible and provide log
snippests):
Only 1 osd is up after ODF installation and  no more rook-ceph-osd-prepare-ocs are coming up for since first OSD. Also rook-ceph-rgw-storagecluster-cephobjectstore is in crash loopback.


Version of all relevant components (if applicable):
quay.io/rhceph-dev/ocs-registry:4.9.0-123.ci (ODF installation)
ocp 4.9.0-0.nightly-2021-09-01-193941

Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?
Product not installed correctly.

Is there any workaround available to the best of your knowledge?
No

Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?
1

Can this issue reproducible?
Yes

Can this issue reproduce from the UI?
Yes

If this is a regression, please provide more details to justify this:
Yes- ODF 4.9.0-118.ci worked

Steps to Reproduce:
1. Install OCP4.9 + ODF
2. create storageSystem
3. Check pods


Actual results:
Only one OSD is up and no prepare pods for rest of OSDs

Expected results:
All OSD are up and running.

Additional info: