Description of problem (please be detailed as possible and provide log snippets): Tier1 test "tests/e2e/workloads/app/amq/test_rgw_kafka_notifications.py::TestRGWAndKafkaNotifications::test_rgw_kafka_notifications" fails with below error. > raise Exception( "Error: Messages are not recieved from Kafka side." "RGW bucket notification is not working as expected." ) E Exception: Error: Messages are not recieved from Kafka side.RGW bucket notification is not working as expected. Version of all relevant components (if applicable): OCP 4.13.0-rc.6 ODF 4.13.0-203 Does this issue impact your ability to continue to work with the product (please explain in detail what is the user impact)? Is there any workaround available to the best of your knowledge? Rate from 1 - 5 the complexity of the scenario you performed that caused this bug (1 - very simple, 5 - very complex)? Can this issue reproducible? yes Can this issue reproduce from the UI? If this is a regression, please provide more details to justify this: Steps to Reproduce: 1. Install OCP and ODF 4.13 2. Execute tier1 test "tests/e2e/workloads/app/amq/test_rgw_kafka_notifications.py::TestRGWAndKafkaNotifications::test_rgw_kafka_notifications" 3. Actual results: Expected results: Additional info: Logs available in google drive : https://drive.google.com/file/d/180nzo7xi8cWU_wy3aVb1MteOPYI1AiNp/view?usp=sharing
Jiffin, PTAL
Reran the test again after setting debug level as mentioned. sh-5.1$ ceph config set client.rgw.ocs.storagecluster.cephobjectstore.a debug_rgw 20 sh-5.1$ ceph config get client.rgw.ocs.storagecluster.cephobjectstore.a debug_rgw 20/20 sh-5.1$ please find the logs here : https://drive.google.com/file/d/1em1jGjkYh3Gax6-JMP_4dGpMwbcNdu_n/view?usp=sharing