Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an index to the each split plugin event #15324

Open
veyselkaraca opened this issue Sep 18, 2023 · 0 comments
Open

Add an index to the each split plugin event #15324

veyselkaraca opened this issue Sep 18, 2023 · 0 comments

Comments

@veyselkaraca
Copy link

veyselkaraca commented Sep 18, 2023

Issue Description:

I would like to propose a new feature for the Logstash split plugin. Currently, when using the split plugin, there is no easy way to track the index or count of the split events generated from the original event. I suggest adding an index to each split plugin event to help users keep track of their position within the split events.

Use Case:

As a Logstash user, I recently encountered a situation where I needed to split a large event into multiple smaller events using the split plugin. However, I also needed to keep track of the index of each split event to perform specific operations or validations based on their position. Unfortunately, Logstash's split plugin does not provide this functionality, so I had to resort to complex workarounds to achieve my desired outcome.

Proposal:

I propose adding an 'index' field to each split event generated by the split plugin. This 'index' field would indicate the position of the split event within the series of split events. For example, if the original event is split into four smaller events, their 'index' values would be 1, 2, 3, and 4, respectively. This would greatly simplify tasks that require tracking the position of split events, such as conditional processing or logging.

Additional Context:

This feature enhancement would not only improve the usability of the split plugin but also make Logstash more versatile for various data processing scenarios. It would save users time and effort by eliminating the need for custom solutions to track split event positions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant