Code

Postgres replication#392

Code

Merged

rudolfix merged 44 commits intomasterdlt-hub/verified-sources:masterfrom 933-postgres-replicationdlt-hub/verified-sources:933-postgres-replicationCopy head branch name to clipboardMay 2, 2024

+2,891-5

Commits

Commits on Feb 25, 2024

• WIP

  

  Jorrit Sandbrink

  committed
  cb58fbc

Commits on Mar 3, 2024

• WIP

  

  Jorrit Sandbrink

  committed
  d218a3a

• Merge branch 'master' of https://github.com/dlt-hub/verified-sources into 933-wip

  

  Jorrit Sandbrink

  committed
  945da6d

Commits on Mar 4, 2024

• move config to correct position

  

  Jorrit Sandbrink

  committed
  fa9a4c1

Commits on Mar 12, 2024

• extend SQLAlchemy type mapping

  

  Jorrit Sandbrink

  committed
  4cdf823

• add initial support for postgres replication

  

  Jorrit Sandbrink

  committed
  8808812

• add credentials instruction

  

  Jorrit Sandbrink

  committed
  1914acf

• Merge branch 'master' of https://github.com/dlt-hub/verified-sources into 933-postgres-replication

  

  Jorrit Sandbrink

  committed
  36739ec

• undo adding secret

  

  Jorrit Sandbrink

  committed
  cc6a11d

• add module docstring

  

  Jorrit Sandbrink

  committed
  f815361

Commits on Mar 13, 2024

• use from import to prevent AttributeError when running test_dlt_init.py

  

  Jorrit Sandbrink

  committed
  a318fee

Commits on Mar 15, 2024

• enable multiple tables per publication

  

  Jorrit Sandbrink

  committed
  8aed399

Commits on Mar 16, 2024

• add support for schema replication

  

  Jorrit Sandbrink

  committed
  9fc3c39

• add support for unmapped data types

  

  Jorrit Sandbrink

  committed
  8c2f905

Commits on Mar 17, 2024

• add test for init_replication

  

  Jorrit Sandbrink

  committed
  a0af605

• update docstrings

  

  Jorrit Sandbrink

  committed
  051830c

• return resource instead of single-element list

  

  Jorrit Sandbrink

  committed
  656989a

Commits on Mar 18, 2024

• add example pipeline

  

  Jorrit Sandbrink

  committed
  d014645

• add more example pipelines

  

  Jorrit Sandbrink

  committed
  269422e

• add nullability hints

  

  Jorrit Sandbrink

  committed
  c674f24

• add README

  

  Jorrit Sandbrink

  committed
  a919c82

Commits on Mar 19, 2024

• add sql_database dependency instruction

  

  Jorrit Sandbrink

  committed
  57b5e1e

Commits on Mar 22, 2024

• batch data items per table and yield hints only once

  

  Jorrit Sandbrink

  committed
  5636e07

• postpone replication column hints to preserve order

  

  Jorrit Sandbrink

  committed
  2713464

• refactor to use resource decorator

  

  Jorrit Sandbrink

  committed
  eec75f0

• Merge branch 'master' of https://github.com/dlt-hub/verified-sources into 933-postgres-replication

  

  Jorrit Sandbrink

  committed
  aae3754

Commits on Mar 23, 2024

• add support for table schema changes

  

  Jorrit Sandbrink

  committed
  493147d

Commits on Mar 25, 2024

• optimize message type detection for performance

  

  Jorrit Sandbrink

  committed
  7bd211b

Commits on Apr 9, 2024

• upgrade dlt to 0.4.8

  

  Jorrit Sandbrink

  committed
  48442ba

• Merge branch 'master' of https://github.com/dlt-hub/verified-sources into 933-postgres-replication

  

  Jorrit Sandbrink

  committed
  d303efd

Commits on Apr 14, 2024

• enables to run tests in parallel

  rudolfix

  committed
  524945f

• Merge branch 'master' into 933-postgres-replication

  rudolfix

  committed
  ab005a1

• fixes format

  rudolfix

  committed
  c596180

Commits on Apr 15, 2024

• make test more specific to handle postgres version differences

  

  Jorrit Sandbrink

  committed
  34610b6

• add postgres server version requirement for schema replication functionality

  

  Jorrit Sandbrink

  committed
  7a07045

• removed whitespace

  

  Jorrit Sandbrink

  committed
  61712b4

Commits on Apr 22, 2024

• explicitly fetch credentials from pg_replication source

  

  Jorrit Sandbrink

  committed
  fd1d973

• add superuser check

  

  Jorrit Sandbrink

  committed
  8bc4da3

Commits on May 1, 2024

• Merge branch 'master' into 933-postgres-replication

  rudolfix

  committed
  796c980

• updates lock file

  rudolfix

  committed
  77fb1dd

Commits on May 2, 2024

• use psycopg2-binary instead of psycopg2

  

  Jorrit Sandbrink

  committed
  8a1d910

• use destination-specific escape identifier

  

  Jorrit Sandbrink

  committed
  b0d2abb

• replace string literal with int literal

  

  Jorrit Sandbrink

  committed
  f63ceff

• include pypgoutput decoders in library

  

  Jorrit Sandbrink

  committed
  22758fe