From d5020dc9f175643cf71163fcb3302f4f9e9e1ed4 Mon Sep 17 00:00:00 2001 From: chanikag Date: Wed, 20 Nov 2024 10:16:15 +0530 Subject: [PATCH 1/3] Add kafka inbound endpoint properties This is to fix https://github.com/wso2/docs-mi/issues/1076 --- .../kafka-connector/kafka-inbound-endpoint-config.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md b/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md index 14137615a..0fd993a29 100644 --- a/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md +++ b/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md @@ -67,6 +67,11 @@ The following parameters are required when configuring Kafka Inbound Endpoint. Offsets are committed automatically with a frequency controlled by the config. 5000 + + failure.retry.count + The offset set to the same record until the failure retry count exceeded. + -1 + session.timeout.ms The timeout used to detect client failures when using Kafka’s group management facility. @@ -388,3 +393,6 @@ The following parameters are required when configuring Kafka Inbound Endpoint. False + +!!! Note + The `` should set in the fault sequence to poll the same record if in a failure case. The internal logic does not commit if the above property set and the offset set to the current record. The `failure.retry.count` used to control the same record polling in a failure scenario. The offset set to next discarding the current record after exceeding the retry count. The default value is `-1` means infinitely polling the same record in failure cases. The `` and `failure.retry.count` parameter only effective when `enable.auto.commit` set to `false`. From ba78c0e74df5ecfeb49ec1941dbf0d95dae09937 Mon Sep 17 00:00:00 2001 From: chanikag Date: Fri, 22 Nov 2024 08:14:30 +0530 Subject: [PATCH 2/3] Update en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md Co-authored-by: Dinithi Navodya Dias <33226735+DinithiDiaz@users.noreply.github.com> --- .../connectors/kafka-connector/kafka-inbound-endpoint-config.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md b/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md index 0fd993a29..01d5ed2bb 100644 --- a/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md +++ b/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md @@ -69,7 +69,7 @@ The following parameters are required when configuring Kafka Inbound Endpoint. failure.retry.count - The offset set to the same record until the failure retry count exceeded. + The offset set to the same record until the failure retry count exceeds. -1 From 72c011ef2437f88a52075847a0059794e9bc33f8 Mon Sep 17 00:00:00 2001 From: chanikag Date: Fri, 22 Nov 2024 08:15:51 +0530 Subject: [PATCH 3/3] Update en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md Co-authored-by: Dinithi Navodya Dias <33226735+DinithiDiaz@users.noreply.github.com> --- .../connectors/kafka-connector/kafka-inbound-endpoint-config.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md b/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md index 01d5ed2bb..909a079eb 100644 --- a/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md +++ b/en/docs/reference/connectors/kafka-connector/kafka-inbound-endpoint-config.md @@ -395,4 +395,4 @@ The following parameters are required when configuring Kafka Inbound Endpoint. !!! Note - The `` should set in the fault sequence to poll the same record if in a failure case. The internal logic does not commit if the above property set and the offset set to the current record. The `failure.retry.count` used to control the same record polling in a failure scenario. The offset set to next discarding the current record after exceeding the retry count. The default value is `-1` means infinitely polling the same record in failure cases. The `` and `failure.retry.count` parameter only effective when `enable.auto.commit` set to `false`. + The `` property should be set in the fault sequence to poll the same record if in a failure case. The internal logic does not commit if the above property is set and the offset is set to the current record. The `failure.retry.count` parameter controls the polling of the same record during failure scenarios. If the retry count is exceeded, the offset is set to the next record, discarding the current one. The default value is `-1`, meaning the same record will be polled infinitely in failure cases. Both the `` and `failure.retry.count` parameters are effective only when `enable.auto.commit` is set to `false`.