Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Doc] update doc about shared-data mode ingestion rate limit #54606

Merged
merged 4 commits into from
Jan 3, 2025
Merged

[Doc] update doc about shared-data mode ingestion rate limit #54606

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
b28c3cf
[Doc] update doc about shared-data mode ingestion rate limit
luohaha Jan 2, 2025
6fb5255
update
luohaha Jan 2, 2025
f972587
Update FE_configuration.md
EsoragotoSpirit Jan 3, 2025
e374b76
Update FE_configuration.md
EsoragotoSpirit Jan 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions docs/en/administration/management/FE_configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3140,11 +3140,11 @@ ADMIN SET FRONTEND CONFIG ("key" = "value");

##### lake_enable_ingest_slowdown

- Default: false
- Default: true
- Type: Boolean
- Unit: -
- Is mutable: Yes
- Description: Whether to enable Data Ingestion Slowdown in a shared-data cluster. When Data Ingestion Slowdown is enabled, if the Compaction Score of a partition exceeds `lake_ingest_slowdown_threshold`, loading tasks on that partition will be throttled down. This configuration only takes effect when `run_mode` is set to `shared_data`.
- Description: Whether to enable Data Ingestion Slowdown in a shared-data cluster. When Data Ingestion Slowdown is enabled, if the Compaction Score of a partition exceeds `lake_ingest_slowdown_threshold`, loading tasks on that partition will be throttled down. This configuration only takes effect when `run_mode` is set to `shared_data`. From v3.3.6 onwards, the default value is chenged from `false` to `true`.
- Introduced in: v3.2.0

##### lake_ingest_slowdown_threshold
Expand Down Expand Up @@ -3176,11 +3176,11 @@ ADMIN SET FRONTEND CONFIG ("key" = "value");

##### lake_compaction_score_upper_bound

- Default: 0
- Default: 2000
- Type: Long
- Unit: -
- Is mutable: Yes
- Description: The upper limit of the Compaction Score for a partition in a shared-data cluster. `0` indicates no upper limit. This item only takes effect when `lake_enable_ingest_slowdown` is set to `true`. When the Compaction Score of a partition reaches or exceeds this upper limit, all loading tasks on that partition will be indefinitely delayed until the Compaction Score drops below this value or the task times out.
- Description: The upper limit of the Compaction Score for a partition in a shared-data cluster. `0` indicates no upper limit. This item only takes effect when `lake_enable_ingest_slowdown` is set to `true`. When the Compaction Score of a partition reaches or exceeds this upper limit, incoming loading tasks will be rejected. From v3.3.6 onwards, the default value is changed from `0` to `2000`.
- Introduced in: v3.2.0

##### lake_compaction_disable_tables
Expand Down
8 changes: 4 additions & 4 deletions docs/zh/administration/management/FE_configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3133,11 +3133,11 @@ Compaction Score 代表了一个表分区是否值得进行 Compaction 的评分

##### lake_enable_ingest_slowdown

- 默认值：false
- 默认值：true
- 类型：Boolean
- 单位：-
- 是否动态：是
- 描述：是否为存算分离集群开启导入限速功能。开启导入限速功能后，当某个表分区的 Compaction Score 超过了 `lake_ingest_slowdown_threshold`，该表分区上的导入任务将会被限速。只有当 `run_mode` 设置为 `shared_data` 后，该配置项才会生效。
- 描述：是否为存算分离集群开启导入限速功能。开启导入限速功能后，当某个表分区的 Compaction Score 超过了 `lake_ingest_slowdown_threshold`，该表分区上的导入任务将会被限速。只有当 `run_mode` 设置为 `shared_data` 后，该配置项才会生效。自 v3.3.6 起，默认值由 `false` 变为 `true`。
- 引入版本：v3.2.0

##### lake_ingest_slowdown_threshold
Expand Down Expand Up @@ -3173,11 +3173,11 @@ Compaction Score 代表了一个表分区是否值得进行 Compaction 的评分

##### lake_compaction_score_upper_bound

- 默认值：0
- 默认值：2000
- 类型：Long
- 单位：-
- 是否动态：是
- 描述：表分区的 Compaction Score 的上限, `0` 表示没有上限。只有当 `lake_enable_ingest_slowdown` 设置为 `true` 后，该配置项才会生效。当表分区 Compaction Score 达到或超过该上限后，所有涉及到该分区的导入任务将会被无限延迟提交，直到 Compaction Score 降到该值以下或者任务超时。
- 描述：表分区的 Compaction Score 的上限, `0` 表示没有上限。只有当 `lake_enable_ingest_slowdown` 设置为 `true` 后，该配置项才会生效。当表分区 Compaction Score 达到或超过该上限后，新的导入会被拒绝。自 v3.3.6 起，默认值由 `0` 变为 `2000`。
- 引入版本：v3.2.0

##### lake_compaction_disable_tables
Expand Down
Loading