Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't deprecate without like functionality #28

Open
johnarnold opened this issue May 3, 2016 · 1 comment
Open

Don't deprecate without like functionality #28

johnarnold opened this issue May 3, 2016 · 1 comment

Comments

@johnarnold
Copy link

Hi,

The documentation states that this filter is being deprecated in favor of the multiline codec. However, multiline codec doesn't support custom stream_identity's and therefore can't do transaction id style streams over a single input (a great example is Cisco ACS AAA logs).

From the wayback machine, here's some examples of people trying to do this.
https://logstash.jira.com/browse/LOGSTASH-1785
It also shows up in google and other open issues / JIRA's.

If you want to add a regex/grok to the multiline codec to support custom stream_identity that would probably suffice for most -- although it's not as "clean" as the filter implementation against fully formed events.

There's an interesting reference to "sub-stream patterns" here which is a similar idea:
logstash-plugins/logstash-codec-multiline#22

Is there a way to do transaction id style multiline in 5.0.0?

Thanks,
John

@seefood
Copy link

seefood commented May 30, 2018

I also have to say losing this is a problem, as I don't see a solution other than this for my current issue:
I have docker containers write out their logs via the json-file driver (anything else and it's a lot of junk in the syslog or just hard to seperate logs from multiple containers), but since filebeats collects them as json, it's too late to multiline at input, I have to do that as a filter. Unless I'm missing something important?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants