Merge pull request #2531 from ClickHouse/kinesis_enhanced_fanout

Add blurb about enhanced fanout for kinesis and update permissions to reflect the new requirements
ClickHouse · Jul 26, 2024 · c9873f1 · c9873f1
2 parents c64be83 + 8709005
commit c9873f1
Show file tree

Hide file tree

Showing 2 changed files with 6 additions and 2 deletions.
diff --git a/docs/en/integrations/data-ingestion/clickpipes/kinesis.md b/docs/en/integrations/data-ingestion/clickpipes/kinesis.md
@@ -26,7 +26,7 @@ You have familiarized yourself with the [ClickPipes intro](./index.md) and setup
 
   ![Fill out connection details](./images/cp_step2_kinesis.png)
 
-5. Select Kinesis Stream and starting offset. The UI will display a sample document from the selected source (Kafka topic, etc).
+5. Select Kinesis Stream and starting offset. The UI will display a sample document from the selected source (Kafka topic, etc). You can also enable Enhanced Fan-out for Kinesis streams to improve the performance and stability of your ClickPipe (More information on Enhanced Fan-out can be found [here](https://aws.amazon.com/blogs/aws/kds-enhanced-fanout))
 
   ![Set data format and topic](./images/cp_step3_kinesis.png)
 

diff --git a/docs/en/integrations/data-ingestion/clickpipes/secure-kinesis.md b/docs/en/integrations/data-ingestion/clickpipes/secure-kinesis.md
@@ -68,7 +68,11 @@ IAM policy (Please replace {STREAM_NAME} with your kinesis stream name):
                 "kinesis:DescribeStream",
                 "kinesis:GetShardIterator",
                 "kinesis:GetRecords",
-                "kinesis:ListShards"
+                "kinesis:ListShards",
+                "kinesis:SubscribeToShard",
+                "kinesis:DescribeStreamConsumer",
+                "kinesis:RegisterStreamConsumer",
+                "kinesis:DeregisterStreamConsumer"
             ],
             "Resource": [
                 "arn:aws:kinesis:region:account-id:stream/{STREAM_NAME}"