Skip to content
This repository has been archived by the owner on Jan 29, 2024. It is now read-only.

Commit

Permalink
monitoring and logs part1
Browse files Browse the repository at this point in the history
  • Loading branch information
wojcik-dorota committed Dec 21, 2023
1 parent 20c392e commit 6b01df3
Show file tree
Hide file tree
Showing 5 changed files with 14 additions and 26 deletions.
2 changes: 1 addition & 1 deletion docs/integrations/cloudwatch/cloudwatch-logs-console.rst
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ Send logs from an Aiven service to AWS CloudWatch

Follow the steps in this section for each of the services whose logs should be sent to AWS CloudWatch.

1. On the **Service Overview** page, select **Manage integrations** and choose the **AWS CloudWatch Logs** option.
1. On the **Overview** page of your service, select **Integrations** and choose the **Amazon CloudWatch Logs** option.

.. image:: /images/integrations/cloudwatch-overview-integrations.png
:alt: Screenshot of system integrations including AWS CloudWatch Logs
Expand Down
2 changes: 1 addition & 1 deletion docs/integrations/cloudwatch/cloudwatch-metrics.rst
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ Send metrics from an Aiven service to AWS CloudWatch

Follow the steps in this section for each of the services whose metrics should be sent to your AWS CloudWatch.

1. From the **Service Overview** page, select **Manage integrations** and choose the **AWS CloudWatch Metrics** option.
1. From the **Overview** page of your service, select **Integrations** and choose the **Amazon CloudWatch Metrics** option.

.. image:: /images/integrations/cloudwatch-overview-integrations.png
:alt: Screenshot of system integrations including AWS CloudWatch Metrics
Expand Down
4 changes: 2 additions & 2 deletions docs/platform/concepts/logs-metrics-alerts.rst
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,12 @@ Administrators can configure log and metrics integrations to Aiven services so t
Logs
----

Choose **Manage integrations** from the service overview page to add an integration that will send service logs to an Aiven for OpenSearch® service. This can be an existing service, or you can choose to create a new one.
On the **Overview** page of your service, select **Integrations** to add an integration that will send service logs to an Aiven for OpenSearch® service. This can be an existing service, or you can choose to create a new one.

Metrics
-------

On the service overview page, choose **Manage integrations** to set up an integration to push service metrics to an M3, InfluxDB® or PostgreSQL® service on Aiven. This can be an existing service or you can create a new one to receive the metrics.
On the **Overview** page of your service, select **Integrations** to set up an integration to push service metrics to an M3, InfluxDB® or PostgreSQL® service on Aiven. This can be an existing service or you can create a new one to receive the metrics.

Dashboards
----------
Expand Down
32 changes: 10 additions & 22 deletions docs/tutorials/anomaly-detection.rst
Original file line number Diff line number Diff line change
Expand Up @@ -119,17 +119,15 @@ The :doc:`Aiven for Apache Kafka </docs/products/kafka>` service is responsible
Customise the Aiven for Apache Kafka service
''''''''''''''''''''''''''''''''''''''''''''

Now that your service is created, you need to customise its functionality. In the **Overview** tab of your freshly created service, you'll see a bunch of toggles and properties. Change these two:
Now that your service is created, you need to customise its functionality. On the **Service settings** page of your freshly created service, you'll see a bunch of toggles and properties. Change these two:

1. Enable the Apache Kafka REST APIs to manage and query via the Aiven Console.

Navigate to **Kafka REST API (Karapace)** > **Enable**.

Navigate to **Service settings** page > **Service management** section > actions (**...**) menu > **Enable REST API (Karapace)**.

2. Enable the :doc:`automatic creation of Apache Kafka topics </docs/products/kafka/howto/create-topics-automatically>` to create new Apache Kafka® topics on the fly while pushing a first record.

Navigate to **Advanced configuration** > **Add configuration option** > ``kafka.auto_create_topics_enable``, switch the setting on and then click **Save advanced configuration**.

Navigate to **Service settings** page > **Advanced configuration** section > **Configure** > **Add configuration options** > ``kafka.auto_create_topics_enable``, enable the selected parameter using the toggle switch, and select **Save configuration**.

Create an Aiven for PostgreSQL® service
'''''''''''''''''''''''''''''''''''''''''
Expand All @@ -147,9 +145,9 @@ You can create the Aiven for PostgreSQL database with the following steps:

5. Select `Startup-4` as service plan. The `Startup-4` plan allows you to define the service integrations needed to define Apache Flink streaming transformations over the data in the PostgreSQL® table.

5. Enter ``demo-postgresql`` as name for your service.
6. Enter ``demo-postgresql`` as name for your service.

6. Click **Create service** under the summary on the right side of the console
7. Click **Create service** under the summary on the right side of the console


Create an Aiven for Apache Flink service
Expand All @@ -172,8 +170,6 @@ You can create the Aiven for Apache Flink service with the following steps:

6. Click **Create Service** under the summary on the right side of the console.



Integrate Aiven for Apache Flink service with sources and sinks
'''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''''

Expand All @@ -182,26 +178,18 @@ After creating the service, you'll be redirected to the service details page. Ap
* Aiven for Apache Kafka®, which contains the stream of IoT sensor readings.
* Aiven for PostgreSQL®, which contains the alerting thresholds.

You can define the service integrations, in the Aiven for Apache Flink® **Overview** tab, with the following steps:

1. Click **Get started** on the banner at the top of the **Overview** page.
You can define the service integrations, on the Aiven for Apache Flink® **Overview** page, with the following steps:

.. image:: /images/tutorials/anomaly-detection/flink-console-integration.png
:alt: Aiven for Apache Flink Overview tab, showing the **Get started** button

2. Select **Aiven for Apache Kafka®** and then select the ``demo-kafka`` service.
3. Click **Integrate**.
4. Click the **+** icon under *Data Flow*.
5. Check the **Aiven for PostgreSQL** checkbox in the ``Aiven Data Services`` section.
6. Select **Aiven for PostgreSQL®** and then select the ``demo-postgresql`` service.
7. Click **Integrate**.
1. Select **Create data pipeline** in section **Create and manage your data streams with ease** at the top of the **Overview** page.
2. In the **Data Service Integrations** window, select the **Aiven for Apache Kafka** checkbox and, next, select the ``demo-kafka`` service. Select **Integrate**.
3. Back on the **Overview** page, in the **Data Flow** section, select the **+** icon.
4. In the **Data Service Integrations** window, select the **Aiven for PostgreSQL** checkbox and, next, select the ``demo-postgresql`` service. Select **Integrate**.

Once the above steps are completed, your **Data Flow** section should be similar to the below:

.. image:: /images/tutorials/anomaly-detection/flink-integrations-done.png
:alt: Aiven for Apache Flink Overview tab, showing the Integrations to Aiven for Apache Kafka and Aiven for PostgreSQL


Set up the IoT metrics streaming dataset
----------------------------------------

Expand Down
Binary file not shown.

0 comments on commit 6b01df3

Please sign in to comment.