Skip to content
This repository has been archived by the owner on Jan 29, 2024. It is now read-only.

Commit

Permalink
Merge branch 'main' into harshini-kafka-blog-into-concepts
Browse files Browse the repository at this point in the history
  • Loading branch information
harshini-rangaswamy authored Jan 12, 2024

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
2 parents f576a4f + d6352a4 commit d077319
Showing 74 changed files with 168 additions and 102 deletions.
10 changes: 10 additions & 0 deletions _redirects
Original file line number Diff line number Diff line change
@@ -92,6 +92,16 @@
/docs/tools/cli/account/account-authentication-method /docs/tools/cli/account
/docs/tools/cli/card /docs/tools/cli/account
/docs/tools/api/examples /docs/tools/api
/docs/products/postgresql/getting-started /docs/products/postgresql/get-started
/docs/products/m3db/getting-started /docs/products/m3db/get-started
/docs/products/flink/getting-started /docs/products/flink/get-started
/docs/products/kafka/getting-started /docs/products/kafka/get-started
/docs/products/clickhouse/getting-started /docs/products/clickhouse/get-started
/docs/products/opensearch/getting-started /docs/products/opensearch/get-started
/docs/products/kafka/karapace/getting-started /docs/products/kafka/karapace/get-started
/docs/products/kafka/kafka-connect/getting-started /docs/products/kafka/kafka-connect/get-started
/docs/products/opensearch/dashboards/getting-started /docs/products/opensearch/dashboards/get-started
/docs/products/kafka/kafka-mirrormaker/getting-started /docs/products/kafka/kafka-mirrormaker/get-started

# Redirect from .index.html to specific page names for landing

20 changes: 10 additions & 10 deletions _toc.yml
Original file line number Diff line number Diff line change
@@ -313,7 +313,7 @@ entries:
- file: docs/products/kafka
title: Apache Kafka
entries:
- file: docs/products/kafka/getting-started
- file: docs/products/kafka/get-started
title: Get started
- file: docs/products/kafka/howto/fake-sample-data
title: Sample data generator
@@ -449,7 +449,7 @@ entries:
- file: docs/products/kafka/kafka-connect
title: Apache Kafka Connect
entries:
- file: docs/products/kafka/kafka-connect/getting-started
- file: docs/products/kafka/kafka-connect/get-started
- file: docs/products/kafka/kafka-connect/concepts
entries:
- file: docs/products/kafka/kafka-connect/concepts/list-of-connector-plugins
@@ -560,7 +560,7 @@ entries:
- file: docs/products/kafka/kafka-mirrormaker
title: Apache Kafka MirrorMaker2
entries:
- file: docs/products/kafka/kafka-mirrormaker/getting-started
- file: docs/products/kafka/kafka-mirrormaker/get-started
- file: docs/products/kafka/kafka-mirrormaker/concepts
entries:
- file: docs/products/kafka/kafka-mirrormaker/concepts/disaster-recovery-migration
@@ -587,7 +587,7 @@ entries:
- file: docs/products/kafka/karapace
title: Karapace
entries:
- file: docs/products/kafka/karapace/getting-started
- file: docs/products/kafka/karapace/get-started
- file: docs/products/kafka/karapace/concepts
title: Concepts
entries:
@@ -621,7 +621,7 @@ entries:
title: Plans and pricing
- file: docs/products/flink/reference/flink-limitations
title: Limitations
- file: docs/products/flink/getting-started
- file: docs/products/flink/get-started
title: Quickstart
- file: docs/products/flink/concepts
title: Concepts
@@ -767,7 +767,7 @@ entries:
title: Plans and pricing
- file: docs/products/clickhouse/reference/limitations
title: Limits and limitations
- file: docs/products/clickhouse/getting-started
- file: docs/products/clickhouse/get-started
title: Quickstart
- file: docs/products/clickhouse/concepts
title: Concepts
@@ -985,7 +985,7 @@ entries:
- file: docs/products/m3db
title: M3DB
entries:
- file: docs/products/m3db/getting-started
- file: docs/products/m3db/get-started
title: Get started
- file: docs/products/m3db/concepts
title: Concepts
@@ -1083,7 +1083,7 @@ entries:
- file: docs/products/opensearch
title: OpenSearch
entries:
- file: docs/products/opensearch/getting-started
- file: docs/products/opensearch/get-started
title: Quickstart
entries:
- file: docs/products/opensearch/howto/sample-dataset
@@ -1182,7 +1182,7 @@ entries:
- file: docs/products/opensearch/dashboards
title: OpenSearch Dashboards
entries:
- file: docs/products/opensearch/dashboards/getting-started
- file: docs/products/opensearch/dashboards/get-started
- file: docs/products/opensearch/dashboards/howto
title: HowTo
entries:
@@ -1209,7 +1209,7 @@ entries:
entries:
- file: docs/products/postgresql/overview
title: Overview
- file: docs/products/postgresql/getting-started
- file: docs/products/postgresql/get-started
title: Quickstart
- file: docs/products/postgresql/concepts
title: Concepts
2 changes: 1 addition & 1 deletion docs/platform/concepts/availability-zones.rst
Original file line number Diff line number Diff line change
@@ -62,7 +62,7 @@ Aiven supports a subset of existing Azure cloud regions with availability zones.
- ``azure-westeurope``
- ``azure-westus2``

Related reading
Related pages
---------------

- :doc:`PostgreSQL® backups </docs/products/postgresql/concepts/pg-backups>`
2 changes: 1 addition & 1 deletion docs/platform/howto/disk-autoscaler.rst
Original file line number Diff line number Diff line change
@@ -290,7 +290,7 @@ You can disable disk autoscaler on your service with the :doc:`Aiven CLI client
avn service integration-endpoint-delete ENDPOINT_ID
Related reading
Related pages
---------------

:doc:`Dynamic disk sizing (DDS) </docs/platform/concepts/dynamic-disk-sizing>`
2 changes: 1 addition & 1 deletion docs/platform/howto/vpc-peering-upcloud.rst
Original file line number Diff line number Diff line change
@@ -160,7 +160,7 @@ To refresh the DHCP lease for a network interface, run the following commands:
dhclient NETWORK_INTERFACE_NAME
Related reading
Related pages
---------------

* :doc:`Manage Virtual Private Cloud (VPC) peering </docs/platform/howto/manage-vpc-peering>`
Original file line number Diff line number Diff line change
@@ -272,7 +272,7 @@ What's next
* :doc:`Manage CCR on Aiven for Apache Cassandra </docs/products/cassandra/howto/manage-cross-cluster-replication>`
* :doc:`Disable CCR on Aiven for Apache Cassandra </docs/products/cassandra/howto/disable-cross-cluster-replication>`

Related reading
Related pages
---------------

* :doc:`About cross-cluster replication on Aiven for Apache Cassandra </docs/products/cassandra/concepts/cross-cluster-replication>`
2 changes: 1 addition & 1 deletion docs/products/cassandra/howto/zdm-proxy.rst
Original file line number Diff line number Diff line change
@@ -246,7 +246,7 @@ You can expect to receive output similar to the following:
``50`` and ``48`` are there in the target table since ZDM Proxy has forwarded the write request to the target service. ``42``, ``44``, and ``46`` are not there since ZDM Proxy has not sent the read request to the target service.
Related reading
Related pages
---------------
* `zdm-proxy GitHub <https://github.com/datastax/zdm-proxy>`_
Original file line number Diff line number Diff line change
@@ -8,7 +8,7 @@ Get a metrics list for your service

The list of Aiven for Apache Cassandra metrics available in Datadog corresponds to the list of metrics available for the open-source Apache Cassandra and can be checked in `Metrics <https://docs.datadoghq.com/integrations/cassandra/#metrics>`_.

Related reading
Related pages
---------------

* Check how to use Datadog with Aiven services in :doc:`Datadog and Aiven </docs/integrations/datadog/>`.
2 changes: 1 addition & 1 deletion docs/products/clickhouse.rst
Original file line number Diff line number Diff line change
@@ -7,7 +7,7 @@ Aiven for ClickHouse® is a fully managed distributed columnar database based on

.. grid:: 1 2 2 2

.. grid-item-card:: :doc:`Quickstart </docs/products/clickhouse/getting-started>`
.. grid-item-card:: :doc:`Quickstart </docs/products/clickhouse/get-started>`
:shadow: md
:margin: 2 2 0 0

Original file line number Diff line number Diff line change
@@ -76,7 +76,7 @@ What's next
* :doc:`Enable tiered storage in Aiven for ClickHouse </docs/products/clickhouse/howto/enable-tiered-storage>`
* :doc:`Configure data retention thresholds for tiered storage </docs/products/clickhouse/howto/configure-tiered-storage>`

Related reading
Related pages
---------------

* :doc:`Check data volume distribution between different disks </docs/products/clickhouse/howto/check-data-tiered-storage>`
2 changes: 1 addition & 1 deletion docs/products/clickhouse/concepts/disaster-recovery.rst
Original file line number Diff line number Diff line change
@@ -73,7 +73,7 @@ Aiven for ClickHouse has a few restrictions on the disaster recovery capability.

For all the restrictions and limits for Aiven for ClickHouse, see :doc:`Aiven for ClickHouse limits and limitations </docs/products/clickhouse/reference/limitations>`.

Related reading
Related pages
---------------

* :doc:`Disaster Recovery testing scenarios </docs/platform/concepts/disaster-recovery-test-scenarios>`
2 changes: 1 addition & 1 deletion docs/products/clickhouse/concepts/federated-queries.rst
Original file line number Diff line number Diff line change
@@ -46,7 +46,7 @@ Limitations
* Federated queries in Aiven for ClickHouse only support S3-compatible object storage providers for the time being. More external data sources coming soon!
* Virtual tables are only supported for URL sources, using the URL table engine. Stay tuned for us supporting the S3 table engine in the future!

Related reading
Related pages
---------------

* :doc:`Read and pull data from S3 object storages and web resources over HTTP </docs/products/clickhouse/howto/run-federated-queries>`
Original file line number Diff line number Diff line change
@@ -72,7 +72,7 @@ What's next
* :doc:`Transfer data between SSD and object storage </docs/products/clickhouse/howto/transfer-data-tiered-storage>`
* :doc:`Configure data retention thresholds for tiered storage </docs/products/clickhouse/howto/configure-tiered-storage>`

Related reading
Related pages
---------------

* :doc:`About tiered storage in Aiven for ClickHouse </docs/products/clickhouse/concepts/clickhouse-tiered-storage>`
Original file line number Diff line number Diff line change
@@ -83,7 +83,7 @@ What's next

* :doc:`Check data volume distribution between different disks </docs/products/clickhouse/howto/check-data-tiered-storage>`

Related reading
Related pages
---------------

* :doc:`About tiered storage in Aiven for ClickHouse </docs/products/clickhouse/concepts/clickhouse-tiered-storage>`
Original file line number Diff line number Diff line change
@@ -98,7 +98,7 @@ Stop data service integrations

Your integration has been removed along with all the corresponding databases and configuration information.

Related reading
Related pages
---------------

* :doc:`Manage Aiven for ClickHouse® integration databases </docs/products/clickhouse/howto/integration-databases>`
2 changes: 1 addition & 1 deletion docs/products/clickhouse/howto/enable-tiered-storage.rst
Original file line number Diff line number Diff line change
@@ -70,7 +70,7 @@ What's next
* :doc:`Configure data retention thresholds for tiered storage </docs/products/clickhouse/howto/configure-tiered-storage>`
* :doc:`Check data volume distribution between different disks </docs/products/clickhouse/howto/check-data-tiered-storage>`

Related reading
Related pages
---------------

* :doc:`About tiered storage in Aiven for ClickHouse </docs/products/clickhouse/concepts/clickhouse-tiered-storage>`
2 changes: 1 addition & 1 deletion docs/products/clickhouse/howto/integration-databases.rst
Original file line number Diff line number Diff line change
@@ -112,7 +112,7 @@ Delete integration databases

Your integration database has been removed from the **Databases and tables** list.

Related reading
Related pages
---------------

* :doc:`Manage Aiven for ClickHouse® data service integrations </docs/products/clickhouse/howto/data-service-integration>`
2 changes: 1 addition & 1 deletion docs/products/clickhouse/howto/load-dataset.rst
Original file line number Diff line number Diff line change
@@ -29,7 +29,7 @@ Once done, you should have two files available: ``hits_v1.tsv`` and ``visits_v1.
Set up the service and database
-------------------------------

If you don't yet have an Aiven for ClickHouse service, follow the steps in our :doc:`getting started guide </docs/products/clickhouse/getting-started>` to create one.
If you don't yet have an Aiven for ClickHouse service, follow the steps in our :doc:`getting started guide </docs/products/clickhouse/get-started>` to create one.

When you create a service, a default database was already added. However, you can create separate databases specific to your use case. We will create a database with the name ``datasets``, keeping it the same as in the ClickHouse documentation.

2 changes: 1 addition & 1 deletion docs/products/clickhouse/howto/run-federated-queries.rst
Original file line number Diff line number Diff line change
@@ -194,7 +194,7 @@ Once the table is defined, SELECT and INSERT statements execute GET and POST req
INSERT INTO trips_export_endpoint_table
VALUES (8765, 10, now() - INTERVAL 15 MINUTE, now(), 50, 20)
Related reading
Related pages
---------------

* :doc:`About querying external data in Aiven for ClickHouse® </docs/products/clickhouse/concepts/federated-queries>`
Original file line number Diff line number Diff line change
@@ -65,7 +65,7 @@ What's next
* :doc:`Check data distribution between SSD and object storage </docs/products/clickhouse/howto/check-data-tiered-storage>`
* :doc:`Configure data retention thresholds for tiered storage </docs/products/clickhouse/howto/configure-tiered-storage>`

Related reading
Related pages
---------------

* :doc:`About tiered storage in Aiven for ClickHouse </docs/products/clickhouse/concepts/clickhouse-tiered-storage>`
Original file line number Diff line number Diff line change
@@ -8,7 +8,7 @@ Get a metrics list for your service

The list of Aiven for ClickHouse metrics available in Datadog corresponds to the list of metrics available for the open-source ClickHouse and can be checked in `Metrics <https://docs.datadoghq.com/integrations/clickhouse/?tab=host#metrics>`_.

Related reading
Related pages
---------------

* Check how to use Datadog with Aiven services in :doc:`Datadog and Aiven </docs/integrations/datadog/>`.
Original file line number Diff line number Diff line change
@@ -43,7 +43,7 @@ There are a number of drivers (libraries) that use one of :ref:`the fundamental

You can connect to Aiven for ClickHouse with any driver that uses TLS and one of the supported protocols.

Related reading
Related pages
---------------

* :doc:`How to connect to Aiven for ClickHouse using different libraries </docs/products/clickhouse/howto/list-connect-to-service>`
2 changes: 1 addition & 1 deletion docs/products/dragonfly/concepts/overview.rst
Original file line number Diff line number Diff line change
@@ -39,6 +39,6 @@ Use cases

* **Scaling and performance needs:** Perfectly suited for situations where the need for greater scalability and higher throughput goes beyond what Redis OSS can handle.

Related reading
Related pages
----------------
* For detailed information about Dragonfly, refer to `Dragonfly documentation <https://www.dragonflydb.io/docs>`_.
Original file line number Diff line number Diff line change
@@ -101,7 +101,7 @@ Upon successful migration:
Your data is now synchronized to Aiven for Dragonfly, with new writes to the source database being continuously synced.


Related reading
Related pages
---------------

* :doc:`Aiven for Redis®* documentation </docs/products/redis/get-started>`
Original file line number Diff line number Diff line change
@@ -108,7 +108,7 @@ Once the migration is complete:



Related reading
Related pages
---------------
* Migrating to Aiven for Dragonfly
* Aiven for Dragonfly documentation </docs/products/dragonfly/index>`
2 changes: 1 addition & 1 deletion docs/products/flink.rst
Original file line number Diff line number Diff line change
@@ -5,7 +5,7 @@ Aiven for Apache Flink® is a fully managed service that leverages the power of

.. grid:: 1 2 2 2

.. grid-item-card:: :doc:`Quickstart </docs/products/flink/getting-started>`
.. grid-item-card:: :doc:`Quickstart </docs/products/flink/get-started>`
:shadow: md
:margin: 2 2 0 0

2 changes: 1 addition & 1 deletion docs/products/flink/howto/flink-confluent-avro.rst
Original file line number Diff line number Diff line change
@@ -12,7 +12,7 @@ Prerequisites
--------------

* :doc:`Aiven for Apache Flink service </docs/platform/howto/create_new_service>` with Aiven for Apache Kafka® integration. See :doc:`/docs/products/flink/howto/create-integration` for more information.
* Aiven for Apache Kafka® service with Karapace Schema registry enabled. See :doc:`/docs/products/kafka/karapace/getting-started` for more information.
* Aiven for Apache Kafka® service with Karapace Schema registry enabled. See :doc:`/docs/products/kafka/karapace/get-started` for more information.
* By default, Flink cannot create Apache Kafka topics while pushing the first record automatically. To change this behavior, enable in the Aiven for Apache Kafka target service the ``kafka.auto_create_topics_enable`` option in **Advanced configuration** section.

Create an Apache Flink® table with Confluent Avro
2 changes: 1 addition & 1 deletion docs/products/kafka.rst
Original file line number Diff line number Diff line change
@@ -27,7 +27,7 @@ Apache Kafka moves data between systems, and Apache Kafka Connect is how to inte
Get started with Aiven for Apache Kafka
---------------------------------------

Take your first steps with Aiven for Apache Kafka by following our :doc:`/docs/products/kafka/getting-started` article, or browse through our full list of articles:
Take your first steps with Aiven for Apache Kafka by following our :doc:`/docs/products/kafka/get-started` article, or browse through our full list of articles:

.. grid:: 1 2 2 2

2 changes: 1 addition & 1 deletion docs/products/kafka/concepts/kafka-tiered-storage.rst
Original file line number Diff line number Diff line change
@@ -43,7 +43,7 @@ Pricing
Tiered storage costs are determined by the amount of remote storage used, measured in GB/hour. The highest usage level within each hour is the basis for calculating charges.


Related reading
Related pages
----------------

* :doc:`How tiered storage works in Aiven for Apache Kafka® </docs/products/kafka/concepts/tiered-storage-how-it-works>`
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
Schema registry authorization
=============================

The schema registry authorization feature when enabled in :doc:`Karapace schema registry </docs/products/kafka/karapace/getting-started>` allows you to authenticate the user, and control read or write access to the individual resources available in the Schema Registry.
The schema registry authorization feature when enabled in :doc:`Karapace schema registry </docs/products/kafka/karapace/get-started>` allows you to authenticate the user, and control read or write access to the individual resources available in the Schema Registry.

For information on schema registry authorization for Aiven for Apache Kafka® services, see :doc:`Karapace schema registry authorization </docs/products/kafka/karapace/concepts/schema-registry-authorization>`.
2 changes: 1 addition & 1 deletion docs/products/kafka/concepts/tiered-storage-guarantees.rst
Original file line number Diff line number Diff line change
@@ -17,7 +17,7 @@ Let's say you have a topic with a **total retention threshold** of **1000 GB** a
* If the total size of the data exceeds 1000 GB, Apache Kafka will begin deleting the oldest data from remote storage.


Related reading
Related pages
----------------

* :doc:`Tiered storage in Aiven for Apache Kafka® overview </docs/products/kafka/concepts/kafka-tiered-storage>`
4 changes: 2 additions & 2 deletions docs/products/kafka/concepts/tiered-storage-how-it-works.rst
Original file line number Diff line number Diff line change
@@ -50,12 +50,12 @@ Segments are encrypted with 256-bit AES encryption before being uploaded to the



Related reading
Related pages
----------------

* :doc:`Tiered storage in Aiven for Apache Kafka® overview </docs/products/kafka/concepts/kafka-tiered-storage>`
* :doc:`Guarantees </docs/products/kafka/concepts/tiered-storage-guarantees>`
* :doc:`Limitiations </docs/products/kafka/concepts/tiered-storage-limitations>`
* :doc:`Limitations </docs/products/kafka/concepts/tiered-storage-limitations>`
* :doc:`Enabled tiered storage for Aiven for Apache Kafka® service </docs/products/kafka/howto/enable-kafka-tiered-storage>`


Original file line number Diff line number Diff line change
@@ -12,7 +12,7 @@ Limitations
* If you enable tiered storage on a service, you can't migrate the service to a different region or cloud, except for moving to a virtual cloud in the same region. For migration to a different region or cloud, contact `Aiven support <mailto:[email protected]>`_.


Related reading
Related pages
----------------

* :doc:`Tiered storage in Aiven for Apache Kafka® overview </docs/products/kafka/concepts/kafka-tiered-storage>`
Loading

0 comments on commit d077319

Please sign in to comment.