Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IGNITE-23168 Event consumption time metric in CDC consumer #11612

Open
wants to merge 14 commits into
base: master
Choose a base branch
from

Conversation

maksaska
Copy link
Contributor

@maksaska maksaska commented Oct 22, 2024

Within this commit there are 2 metrics implemented:

  • EventsConsumptionTime - Time for which this CDC client processed the WAL segment events, in nanoseconds.
  • EventsConsumptionTimeTotal - The total time for which this CDC client processed the WAL segments events, in nanoseconds.

It will help to monitor the throughput of the transfered cache entries as well as finish time of the proccess.

Thank you for submitting the pull request to the Apache Ignite.

In order to streamline the review of the contribution
we ask you to ensure the following steps have been taken:

The Contribution Checklist

  • There is a single JIRA ticket related to the pull request.
  • The web-link to the pull request is attached to the JIRA ticket.
  • The JIRA ticket has the Patch Available state.
  • The pull request body describes changes that have been made.
    The description explains WHAT and WHY was made instead of HOW.
  • The pull request title is treated as the final commit message.
    The following pattern must be used: IGNITE-XXXX Change summary where XXXX - number of JIRA issue.
  • A reviewer has been mentioned through the JIRA comments
    (see the Maintainers list)
  • The pull request has been checked by the Teamcity Bot and
    the green visa attached to the JIRA ticket (see TC.Bot: Check PR)

Notes

If you need any help, please email [email protected] or ask anу advice on http://asf.slack.com #ignite channel.

Maksim Davydov added 9 commits November 22, 2024 11:55
* Consumer events consumption metric
* Metrics description changed
* Histogram bounds fixed
* minor fixes
* metric units changed
* minor fixes
* redundant metric removed
* minor code style fixes
* minor code style fixes (2)
Maksim Davydov added 2 commits November 22, 2024 12:58
* test refactored
* test refactored
* test refactored
Copy link
Member

@timoninmaxim timoninmaxim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. Metric name is a little bit misleading
  2. Metric isn't updated for passive mode

Maksim Davydov added 2 commits November 26, 2024 16:48
* metric renamed
* metric update case added
* doc & minor fixes
@maksaska
Copy link
Contributor Author

maksaska commented Nov 26, 2024

  1. Metric name is a little bit misleading
  2. Metric isn't updated for passive mode

Done!

@@ -125,6 +125,7 @@ The following metrics are provided by the application (additional metrics can be
| BinaryMetaDir | Binary meta-directory the application reads data from.
| MarshallerDir | Marshaller directory the application reads data from.
| CdcDir | The CDC directory the application reads data from.
| WalProcessingTime | Time of WAL segment processing, in milliseconds.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SegmentConsumingTime

}
else
consumeSegmentActively(builder);

walProcessingTime.value(U.currentTimeMillis() - start);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code duplication

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants