Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade JRuby to 9.4 (to get Zlib::GzipReader.zcat) #15908

Closed
eherot opened this issue Feb 6, 2024 · 2 comments
Closed

Upgrade JRuby to 9.4 (to get Zlib::GzipReader.zcat) #15908

eherot opened this issue Feb 6, 2024 · 2 comments

Comments

@eherot
Copy link

eherot commented Feb 6, 2024

There are probably other good reasons for doing this, but here's the problem I've encountered...

The logstash-input-s3 plugin relies on Ruby's embedded ZLib to decompress GZipped log files, however AWS stores these files in a concatenated form that can't be read by the normal Zlib::GzipReader.new() method. Thankfully a new Zlib::GzipReader.zcat() method was added that can read this type of file, however it is only available in Ruby 3.

Without this it is impossible to stream GZipped log files from S3, so it would be very helpful if JRuby could either be upgraded to a version that includes this feature or if another library could be included as a workaround.

@eherot eherot changed the title Upgrade JRuby to 9.4 Upgrade JRuby to 9.4 (to get Zlib::GzipReader.zcat) Feb 6, 2024
@andsel
Copy link
Contributor

andsel commented Feb 7, 2024

Hi @eherot starting from Logstash 8.10 JRuby 9.4 is bundled with the package: https://www.elastic.co/guide/en/logstash/current/logstash-8-10-0.html

@eherot
Copy link
Author

eherot commented Feb 7, 2024

Oh hello! I looked at /.ruby-version but apparently I wanted /versions.yml. Looks like I'll have to go push on opensearch-project/logstash-output-opensearch instead. Thanks for the quick response at any rate!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants