Bug 2056053

Summary: Elasticsearch output missing from fluent-bit EPEL package
Product: [Fedora] Fedora EPEL Reporter: INVADE International Ltd. <third.line>
Component: fluent-bitAssignee: Ben Kircher <bkircher>
Status: CLOSED ERRATA QA Contact:
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: epel8CC: bkircher, third.line
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: fluent-bit-1.8.12-2.el8 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-03-01 18:54:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description INVADE International Ltd. 2022-02-18 16:14:26 UTC
Description of problem:
Elasticsearch output missing from package.


Version-Release number of selected component (if applicable):
1.8.12-1


How reproducible:
100%


Steps to Reproduce:
1. Install package fluent-bit-1.8.12-1.el8.x86_64 from the EPEL repo.
2. View help info (fluent-bit -h) to view Outputs. Elasticsearch (es) is not listed).
3. Run fluent-bit with the output set to "es". Returns "Error: Invalid output target. Aborting".

Actual results:
Can't use "es" output.


Expected results:
Can use "es" output.

Additional info:
I'm not sure if the Elasticsearch (es) output has been excluded from this package for a specific reason but, if not, could it be included?

The official package from the Fluent Bit repo includes this:
https://docs.fluentbit.io/manual/installation/linux/redhat-centos

plus a few others (Kafka, PostgreSQL, Slack & Treasure Data) but, we prefer to source packages from a limited number of repos so would rather use the EPEL version.

Comment 1 Fedora Update System 2022-02-21 16:33:17 UTC
FEDORA-EPEL-2022-688b76ff01 has been submitted as an update to Fedora EPEL 8. https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2022-688b76ff01

Comment 2 Ben Kircher 2022-02-21 17:40:02 UTC
Thanks for reporting!

I added an update that includes the ES plugin (and some patch to fix ES-related tests). The package NVR is fluent-bit-1.8.12-2

Unfortunately I cannot test the plugin. It would be lovely if you could test if everything works for you with the ES output plugin -- You can download the package here: https://koji.fedoraproject.org/koji/buildinfo?buildID=1921386 -- and could give some feedback either here in this bug or https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2022-688b76ff01. 



> I'm not sure if the Elasticsearch (es) output has been excluded from this package for a specific reason but, if not, could it be included?
> 
> The official package from the Fluent Bit repo includes this:
> https://docs.fluentbit.io/manual/installation/linux/redhat-centos
> 
> plus a few others (Kafka, PostgreSQL, Slack & Treasure Data) but, we prefer to source packages from a limited number of repos so would rather use the EPEL version.

Yes, there was no specific reason other than I didn't need all the plugins for our use case here at my $DAYJOB. I don't really have the infra to test all those plugins and I didn't want to push anything to EPEL without testing.

Anyway, I can clearly see that people might not find their way here to request a missing plugin and just jump on the package provided by upstream.

Comment 3 Fedora Update System 2022-02-22 03:50:52 UTC
FEDORA-EPEL-2022-688b76ff01 has been pushed to the Fedora EPEL 8 testing repository.

You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2022-688b76ff01

See also https://fedoraproject.org/wiki/QA:Updates_Testing for more information on how to test updates.

Comment 4 INVADE International Ltd. 2022-02-22 12:21:59 UTC
Hi.

I can confirm that the updated package appears to be working successfully with the ES plugin.

Many thanks.

Comment 5 Ben Kircher 2022-02-22 12:35:13 UTC
Nice, thanks for the feedback!

Comment 6 Fedora Update System 2022-03-01 18:54:54 UTC
FEDORA-EPEL-2022-688b76ff01 has been pushed to the Fedora EPEL 8 stable repository.
If problem still persists, please make note of it in this bug report.