Code

feat (sync service): multi tenancy#1886

Code

Merged

icehaunter merged 55 commits intomainelectric-sql/electric:mainfrom kevin/multi-tenancy-continuedelectric-sql/electric:kevin/multi-tenancy-continuedCopy head branch name to clipboardNov 5, 2024

+3,020-631

Commits

Commits on Nov 5, 2024

• Add TenantManager that spawns the necessary processes per tenant.

  

  kevin-dp

  authored and

  icehaunter

  committed
  6f776ba

  Copy full SHA for 6f776ba

• Initialize separate storage backend for each tenant

  

  alco

  authored and

  icehaunter

  committed
  dc0352d

  Copy full SHA for dc0352d

• Fix tests

  

  alco

  authored and

  icehaunter

  committed
  ebbb2aa

  Copy full SHA for ebbb2aa

• mix format

  

  alco

  authored and

  icehaunter

  committed
  ed497e1

  Copy full SHA for ed497e1

• Fix missing :storage and :tenant_id options where needed

  

  alco

  authored and

  icehaunter

  committed
  8d55fee

  Copy full SHA for 8d55fee

• Support configuring a default tenant when running in any environment, dev and test included

  

  alco

  authored and

  icehaunter

  committed
  e53a144

  Copy full SHA for e53a144

• Use default tenant for TS integration tests on CI

  

  alco

  authored and

  icehaunter

  committed
  7227b24

  Copy full SHA for 7227b24

• Adjust the health check endpoint for CI

  Show description for e091d1c
  

  alco

  authored and

  icehaunter

  committed
  e091d1c

  Copy full SHA for e091d1c

• fixup! Support configuring a default tenant when running in any environment, dev and test included

  

  alco

  authored and

  icehaunter

  committed
  bebbcdc

  Copy full SHA for bebbcdc

• (tmp) Load requested or default tenant in DeleteShapePlug

  

  alco

  authored and

  icehaunter

  committed
  1b9a3ba

  Copy full SHA for 1b9a3ba

• Add tenant id to .env.dev

  

  msfstef

  authored and

  icehaunter

  committed
  76d9512

  Copy full SHA for 76d9512

• Fix typo in options passed to plug.

  

  kevin-dp

  authored and

  icehaunter

  committed
  badc5e1

  Copy full SHA for badc5e1

• Remove commented tests because they are either obsolete or included in consumer_test

  

  kevin-dp

  authored and

  icehaunter

  committed
  566626b

  Copy full SHA for 566626b

• Fix unit tests.

  

  kevin-dp

  authored and

  icehaunter

  committed
  3213d22

  Copy full SHA for 3213d22

• Make default tenant optional

  

  kevin-dp

  authored and

  icehaunter

  committed
  5769825

  Copy full SHA for 5769825

• rename TENANT_ID env var to DATABASE_ID

  

  kevin-dp

  authored and

  icehaunter

  committed
  f879573

  Copy full SHA for f879573

• Modify health check endpoint to take a database_id

  

  kevin-dp

  authored and

  icehaunter

  committed
  904589e

  Copy full SHA for 904589e

• Restore allow_shape_deletion config option needed for delete shape plug.

  

  kevin-dp

  authored and

  icehaunter

  committed
  5698fce

  Copy full SHA for 5698fce

• Fix react hooks test

  

  kevin-dp

  authored and

  icehaunter

  committed
  7404df8

  Copy full SHA for 7404df8

• Fix rolling deploy integration test

  

  kevin-dp

  authored and

  icehaunter

  committed
  e647177

  Copy full SHA for e647177

• Unit tests for add database plug.

  

  kevin-dp

  authored and

  icehaunter

  committed
  a4556f7

  Copy full SHA for a4556f7

• Add optional databaseId parameter the ShapeStream for selecting a DB in multi tenant mode.

  

  kevin-dp

  authored and

  icehaunter

  committed
  f72bdb7

  Copy full SHA for f72bdb7

• Integration test for multi tenancy

  

  kevin-dp

  authored and

  icehaunter

  committed
  86a4060

  Copy full SHA for 86a4060

• Fix error message in delete shape plug

  

  kevin-dp

  authored and

  icehaunter

  committed
  0e47e49

  Copy full SHA for 0e47e49

• Plug for deleting a tenant

  

  kevin-dp

  authored and

  icehaunter

  committed
  33205ba

  Copy full SHA for 33205ba

• Fix clearShape in test setup

  

  kevin-dp

  authored and

  icehaunter

  committed
  6d122af

  Copy full SHA for 6d122af

• Do not take the tenant ID of the 2nd tenant for tge integration test as an env var

  

  kevin-dp

  authored and

  icehaunter

  committed
  3dab5d5

  Copy full SHA for 3dab5d5

• Rename delete DB plug to remove DB plug.

  

  kevin-dp

  authored and

  icehaunter

  committed
  224d892

  Copy full SHA for 224d892

• Unit tests for remove DB plug

  

  kevin-dp

  authored and

  icehaunter

  committed
  9ef0dcf

  Copy full SHA for 9ef0dcf

• Remove obsolete comment

  

  kevin-dp

  authored and

  icehaunter

  committed
  4a02174

  Copy full SHA for 4a02174

• Extract duplicated functions for loading tenant to utility module.

  

  kevin-dp

  authored and

  icehaunter

  committed
  3c23385

  Copy full SHA for 3c23385

• Return 404 if tenant is not found

  

  kevin-dp

  authored and

  icehaunter

  committed
  350ea8c

  Copy full SHA for 350ea8c

• Update OpenAPI spec

  

  kevin-dp

  authored and

  icehaunter

  committed
  551e56d

  Copy full SHA for 551e56d

• Rename id parameter to database_id in add DB plug

  

  kevin-dp

  authored and

  icehaunter

  committed
  859ac13

  Copy full SHA for 859ac13

• Disable file parallelism in vitest to avoid flaky tests due to some unit tests running concurrently with multi tenancy integration test.

  

  kevin-dp

  authored and

  icehaunter

  committed
  e2be9e6

  Copy full SHA for e2be9e6

• Handle failure to parse connection string

  

  kevin-dp

  authored and

  icehaunter

  committed
  918389d

  Copy full SHA for 918389d

• Store references to per-tenant ETS tables in a global ETS table.

  

  kevin-dp

  authored and

  icehaunter

  committed
  aafb9a5

  Copy full SHA for aafb9a5

• WIP shutting down

  

  kevin-dp

  authored and

  icehaunter

  committed
  4300bfd

  Copy full SHA for 4300bfd

• Reverse error messages

  

  msfstef

  authored and

  icehaunter

  committed
  ad1cb56

  Copy full SHA for ad1cb56

• Shutdown tenant processes and clean up ETS table when tenant is deleted.

  

  kevin-dp

  authored and

  icehaunter

  committed
  23909e7

  Copy full SHA for 23909e7

• Introduce a with_supervised_tenant in component_setup.

  

  kevin-dp

  authored and

  icehaunter

  committed
  4659b15

  Copy full SHA for 4659b15

• Rebase on top of main

  

  kevin-dp

  authored and

  icehaunter

  committed
  73649fb

  Copy full SHA for 73649fb

• Pass tenant_id option to stop_tenant

  

  kevin-dp

  authored and

  icehaunter

  committed
  c92ea4d

  Copy full SHA for c92ea4d

• Persist tenants

  

  kevin-dp

  authored and

  icehaunter

  committed
  0915711

  Copy full SHA for 0915711

• Unit test tenant persistence module

  

  kevin-dp

  authored and

  icehaunter

  committed
  53a1629

  Copy full SHA for 53a1629

• Remove obsolete tenant deletion in component setup

  

  kevin-dp

  authored and

  icehaunter

  committed
  e57db87

  Copy full SHA for e57db87

• Remove tenant from disk when the tenant is deleted.

  

  kevin-dp

  authored and

  icehaunter

  committed
  71a528f

  Copy full SHA for 71a528f

• Unit test that tenant manager loads tenants from storage

  

  kevin-dp

  authored and

  icehaunter

  committed
  30ae9b4

  Copy full SHA for 30ae9b4

• Formatting

  

  kevin-dp

  authored and

  icehaunter

  committed
  92cb589

  Copy full SHA for 92cb589

• Generate unique tenant ID if DB URL is provided but no tenant ID is provided

  

  kevin-dp

  authored and

  icehaunter

  committed
  fc77fc7

  Copy full SHA for fc77fc7

• Log message when tenant is reloaded from storage

  

  kevin-dp

  authored and

  icehaunter

  committed
  c92e74b

  Copy full SHA for c92e74b

• fixes

  icehaunter

  committed
  8537861

  Copy full SHA for 8537861

• Fixed compilation warnings

  icehaunter

  committed
  673d80d

  Copy full SHA for 673d80d

• fixed tests

  icehaunter

  committed
  9733e96

  Copy full SHA for 9733e96

• Fixed API spec

  icehaunter

  committed
  77750ac

  Copy full SHA for 77750ac