We would like the openshift fluentd pods for logging to be able to forward a copy of logs to a kafka endpoint.
Currently my understanding is we can only set the configmap for the fluentd pods to send a copy of data to an ES or a secure forward plugin... when I log onto our current fluentd pods there is no gem install for a kafka endpoint. We would like some kind of fluent-plugin-kafka installed and to be able to use the configmap to enter in a kafka endpoint.
1. Why exactly do you need this feature? (List the business requirements here)
Because our enterprise logging within our company is using kafka and we want all logs to get sent to that endpoint. Currently the red hat fluentd pod cannot sent to this type.
2. How would you like to achieve this? (List the functional requirements here)
Install the gem plugin for kafka and then make it so I can use the openshift fluentd configmap to configure it... just like the secure_forwarder type.
3. Do you have any specific timeline dependencies?
Would be nice to have as soon as possible so we can implement it and remove the extra hope of creating a fluentd pod with kafka plugin just to send data to a kafka endpoint.
4. Would you be able to assist in testing this functionality if implemented?
Yes.
This bug has been identified as a dated (created more than 3 months ago) bug.
This bug has been triaged (has a trello card linked to it), or reviewed by Engineering/PM and has been put into the product backlog,
however this bug has not been slated for a currently planned release (3.9, 3.10 or 3.11), which cover our releases for the rest of the calendar year.
As a result of this bugs age, state on the current roadmap and PM Score (being below 70), this bug is being Closed - Differed,
as it is currently not part of the products immediate priorities.
Please see: https://docs.google.com/document/d/1zdqF4rB3ea8GmVIZ7qWCVYUaQ7-EexUrQEF0MTwdDkw/edit for more details.