Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail to setup replication between aiven on OVH and aiven on GCP (aiven cloud) #39

Open
3 tasks
ZuSe opened this issue Dec 10, 2022 · 0 comments
Open
3 tasks

Comments

@ZuSe
Copy link

ZuSe commented Dec 10, 2022

Description of the issue

Describe the issue you are experiencing.

Issue-Type (put a x sign in the square brackets)

  • [X ] bug report
  • feature request
  • Documentation improvement
  • Other

Checklist

  • [X ] Running latest version of code.
  • [ X] This issue has not been reported earlier.

Your environment

  • OS Ubuntu 22.04
  • Python Version 3.10
  • Release tag/commit of the code

Expected behaviour

Should work out of the box. Espcially given that aiven is the provider of both DBs

Actual behaviour

Setting up a logical replication fails and the script falls back to pg_dump.
However, I need to keep both DBs in sync.
"Logical replication failed with error: 'must be superuser to create FOR ALL TABLES publication', fallback to dump"

Steps to reproduce

setup a PSQL DB on OVH (which is powered by aiven)
Link your GCP account to aiven
Setup a PSQL DB on aiven cloud (hosted on gcp)
Use pg_migrate tool to setup logical replication

Any extra info ( for eg. code snippet to reproduce, logs, screenshots etc. )

pg_migrate -s "postgres://avnadmin:[email protected]:20184/defaultdb" -t "postgres://avnadmin:[email protected]:14837/defaultdb" 2022-12-10 10:40:07,357 PGSource WARNING Couldn't connect to database '_aiven': OperationalError('FATAL: pg_hba.conf rejects connection for host "10.5.130.98", user "avnadmin", database "_aiven", SSL encryption\nconnection to server at "postgresql-48e9e04b-o08a726b8.database.cloud.ovh.net" (10.5.131.80), port 20184 failed: FATAL: no pg_hba.conf entry for host "10.5.130.98", user "avnadmin", database "_aiven", no encryption\n') 2022-12-10 10:40:08,166 PGMigrate INFO Access to source database '_aiven' is rejected 2022-12-10 10:40:08,408 PGTarget WARNING Couldn't connect to database '_aiven': OperationalError('FATAL: pg_hba.conf rejects connection for host "141.94.211.55", user "avnadmin", database "_aiven", SSL encryption\nconnection to server at "production-de-iatros-production.aivencloud.com" (34.xxx.xxx.xxx), port 14837 failed: FATAL: no pg_hba.conf entry for host "141.94.211.55", user "avnadmin", database "_aiven", no encryption\n') 2022-12-10 10:40:08,851 PGMigrate INFO Database 'defaultdb' already exists in target 2022-12-10 10:40:08,970 PGMigrate INFO Database 'account_service_production' will be created in target 2022-12-10 10:40:09,071 PGMigrate INFO Database 'content_service_production' will be created in target 2022-12-10 10:40:09,176 PGMigrate INFO Database 'poll_service_production' will be created in target 2022-12-10 10:40:09,276 PGMigrate INFO Database 'utility_service_production' will be created in target 2022-12-10 10:40:09,393 PGMigrate INFO Database 'reff_service_production' will be created in target 2022-12-10 10:40:09,510 PGMigrate INFO Database 'iatros_sftp_production' will be created in target 2022-12-10 10:40:09,632 PGMigrate INFO Database 'randomization_production' will be created in target 2022-12-10 10:40:10,039 PGMigrate INFO Extension 'plpgsql' is installed in source and target database 'defaultdb', source version: '1.0', target version: '1.0' 2022-12-10 10:40:10,389 PGMigrate INFO Extension 'plpgsql' version '1.0' available for installation in target, source version: '1.0' 2022-12-10 10:40:10,488 PGMigrate INFO Extension 'plpgsql' is whitelisted in target 2022-12-10 10:40:10,488 PGMigrate INFO Extension 'plpgsql' version '1.0' will be installed in target database 'account_service_production' 2022-12-10 10:40:10,599 PGMigrate INFO Extension 'btree_gin' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:10,600 PGMigrate INFO Extension 'btree_gin' is whitelisted in target 2022-12-10 10:40:10,600 PGMigrate INFO Extension 'btree_gin' version '1.3' will be installed in target database 'account_service_production' 2022-12-10 10:40:10,703 PGMigrate INFO Extension 'btree_gist' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:10,703 PGMigrate INFO Extension 'btree_gist' is whitelisted in target 2022-12-10 10:40:10,703 PGMigrate INFO Extension 'btree_gist' version '1.6' will be installed in target database 'account_service_production' 2022-12-10 10:40:10,807 PGMigrate INFO Extension 'citext' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:10,807 PGMigrate INFO Extension 'citext' is whitelisted in target 2022-12-10 10:40:10,807 PGMigrate INFO Extension 'citext' version '1.6' will be installed in target database 'account_service_production' 2022-12-10 10:40:10,910 PGMigrate INFO Extension 'cube' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:10,910 PGMigrate INFO Extension 'cube' is whitelisted in target 2022-12-10 10:40:10,910 PGMigrate INFO Extension 'cube' version '1.5' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,016 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:11,016 PGMigrate INFO Extension 'fuzzystrmatch' is whitelisted in target 2022-12-10 10:40:11,017 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,121 PGMigrate INFO Extension 'hstore' version '1.8' available for installation in target, source version: '1.8' 2022-12-10 10:40:11,121 PGMigrate INFO Extension 'hstore' is whitelisted in target 2022-12-10 10:40:11,121 PGMigrate INFO Extension 'hstore' version '1.8' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,227 PGMigrate INFO Extension 'intarray' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:11,227 PGMigrate INFO Extension 'intarray' is whitelisted in target 2022-12-10 10:40:11,227 PGMigrate INFO Extension 'intarray' version '1.5' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,331 PGMigrate INFO Extension 'isn' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:11,332 PGMigrate INFO Extension 'isn' is whitelisted in target 2022-12-10 10:40:11,332 PGMigrate INFO Extension 'isn' version '1.2' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,434 PGMigrate INFO Extension 'ltree' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:11,434 PGMigrate INFO Extension 'ltree' is whitelisted in target 2022-12-10 10:40:11,434 PGMigrate INFO Extension 'ltree' version '1.2' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,551 PGMigrate INFO Extension 'pg_trgm' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:11,551 PGMigrate INFO Extension 'pg_trgm' is whitelisted in target 2022-12-10 10:40:11,551 PGMigrate INFO Extension 'pg_trgm' version '1.6' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,655 PGMigrate INFO Extension 'pgcrypto' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:11,655 PGMigrate INFO Extension 'pgcrypto' is whitelisted in target 2022-12-10 10:40:11,656 PGMigrate INFO Extension 'pgcrypto' version '1.3' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,759 PGMigrate INFO Extension 'seg' version '1.4' available for installation in target, source version: '1.4' 2022-12-10 10:40:11,760 PGMigrate INFO Extension 'seg' is trusted in target 2022-12-10 10:40:11,760 PGMigrate INFO Extension 'seg' version '1.4' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,864 PGMigrate INFO Extension 'unaccent' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:11,864 PGMigrate INFO Extension 'unaccent' is whitelisted in target 2022-12-10 10:40:11,864 PGMigrate INFO Extension 'unaccent' version '1.1' will be installed in target database 'account_service_production' 2022-12-10 10:40:11,968 PGMigrate INFO Extension 'uuid-ossp' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:11,969 PGMigrate INFO Extension 'uuid-ossp' is whitelisted in target 2022-12-10 10:40:11,969 PGMigrate INFO Extension 'uuid-ossp' version '1.1' will be installed in target database 'account_service_production' 2022-12-10 10:40:12,073 PGMigrate INFO Extension 'plpgsql' version '1.0' available for installation in target, source version: '1.0' 2022-12-10 10:40:12,074 PGMigrate INFO Extension 'plpgsql' is whitelisted in target 2022-12-10 10:40:12,074 PGMigrate INFO Extension 'plpgsql' version '1.0' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,176 PGMigrate INFO Extension 'btree_gin' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:12,176 PGMigrate INFO Extension 'btree_gin' is whitelisted in target 2022-12-10 10:40:12,177 PGMigrate INFO Extension 'btree_gin' version '1.3' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,278 PGMigrate INFO Extension 'btree_gist' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:12,279 PGMigrate INFO Extension 'btree_gist' is whitelisted in target 2022-12-10 10:40:12,279 PGMigrate INFO Extension 'btree_gist' version '1.6' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,381 PGMigrate INFO Extension 'citext' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:12,381 PGMigrate INFO Extension 'citext' is whitelisted in target 2022-12-10 10:40:12,381 PGMigrate INFO Extension 'citext' version '1.6' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,479 PGMigrate INFO Extension 'cube' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:12,479 PGMigrate INFO Extension 'cube' is whitelisted in target 2022-12-10 10:40:12,479 PGMigrate INFO Extension 'cube' version '1.5' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,582 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:12,582 PGMigrate INFO Extension 'fuzzystrmatch' is whitelisted in target 2022-12-10 10:40:12,582 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,690 PGMigrate INFO Extension 'hstore' version '1.8' available for installation in target, source version: '1.8' 2022-12-10 10:40:12,691 PGMigrate INFO Extension 'hstore' is whitelisted in target 2022-12-10 10:40:12,691 PGMigrate INFO Extension 'hstore' version '1.8' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,794 PGMigrate INFO Extension 'intarray' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:12,794 PGMigrate INFO Extension 'intarray' is whitelisted in target 2022-12-10 10:40:12,794 PGMigrate INFO Extension 'intarray' version '1.5' will be installed in target database 'content_service_production' 2022-12-10 10:40:12,897 PGMigrate INFO Extension 'isn' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:12,898 PGMigrate INFO Extension 'isn' is whitelisted in target 2022-12-10 10:40:12,898 PGMigrate INFO Extension 'isn' version '1.2' will be installed in target database 'content_service_production' 2022-12-10 10:40:13,000 PGMigrate INFO Extension 'ltree' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:13,000 PGMigrate INFO Extension 'ltree' is whitelisted in target 2022-12-10 10:40:13,000 PGMigrate INFO Extension 'ltree' version '1.2' will be installed in target database 'content_service_production' 2022-12-10 10:40:13,118 PGMigrate INFO Extension 'pg_trgm' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:13,118 PGMigrate INFO Extension 'pg_trgm' is whitelisted in target 2022-12-10 10:40:13,118 PGMigrate INFO Extension 'pg_trgm' version '1.6' will be installed in target database 'content_service_production' 2022-12-10 10:40:13,222 PGMigrate INFO Extension 'pgcrypto' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:13,223 PGMigrate INFO Extension 'pgcrypto' is whitelisted in target 2022-12-10 10:40:13,223 PGMigrate INFO Extension 'pgcrypto' version '1.3' will be installed in target database 'content_service_production' 2022-12-10 10:40:13,324 PGMigrate INFO Extension 'seg' version '1.4' available for installation in target, source version: '1.4' 2022-12-10 10:40:13,324 PGMigrate INFO Extension 'seg' is trusted in target 2022-12-10 10:40:13,324 PGMigrate INFO Extension 'seg' version '1.4' will be installed in target database 'content_service_production' 2022-12-10 10:40:13,432 PGMigrate INFO Extension 'unaccent' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:13,432 PGMigrate INFO Extension 'unaccent' is whitelisted in target 2022-12-10 10:40:13,432 PGMigrate INFO Extension 'unaccent' version '1.1' will be installed in target database 'content_service_production' 2022-12-10 10:40:13,535 PGMigrate INFO Extension 'uuid-ossp' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:13,536 PGMigrate INFO Extension 'uuid-ossp' is whitelisted in target 2022-12-10 10:40:13,536 PGMigrate INFO Extension 'uuid-ossp' version '1.1' will be installed in target database 'content_service_production' 2022-12-10 10:40:13,639 PGMigrate INFO Extension 'plpgsql' version '1.0' available for installation in target, source version: '1.0' 2022-12-10 10:40:13,639 PGMigrate INFO Extension 'plpgsql' is whitelisted in target 2022-12-10 10:40:13,639 PGMigrate INFO Extension 'plpgsql' version '1.0' will be installed in target database 'poll_service_production' 2022-12-10 10:40:13,740 PGMigrate INFO Extension 'btree_gin' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:13,740 PGMigrate INFO Extension 'btree_gin' is whitelisted in target 2022-12-10 10:40:13,741 PGMigrate INFO Extension 'btree_gin' version '1.3' will be installed in target database 'poll_service_production' 2022-12-10 10:40:13,841 PGMigrate INFO Extension 'btree_gist' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:13,842 PGMigrate INFO Extension 'btree_gist' is whitelisted in target 2022-12-10 10:40:13,842 PGMigrate INFO Extension 'btree_gist' version '1.6' will be installed in target database 'poll_service_production' 2022-12-10 10:40:13,944 PGMigrate INFO Extension 'citext' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:13,944 PGMigrate INFO Extension 'citext' is whitelisted in target 2022-12-10 10:40:13,945 PGMigrate INFO Extension 'citext' version '1.6' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,061 PGMigrate INFO Extension 'cube' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:14,062 PGMigrate INFO Extension 'cube' is whitelisted in target 2022-12-10 10:40:14,062 PGMigrate INFO Extension 'cube' version '1.5' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,164 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:14,165 PGMigrate INFO Extension 'fuzzystrmatch' is whitelisted in target 2022-12-10 10:40:14,165 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,270 PGMigrate INFO Extension 'hstore' version '1.8' available for installation in target, source version: '1.8' 2022-12-10 10:40:14,271 PGMigrate INFO Extension 'hstore' is whitelisted in target 2022-12-10 10:40:14,271 PGMigrate INFO Extension 'hstore' version '1.8' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,376 PGMigrate INFO Extension 'intarray' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:14,376 PGMigrate INFO Extension 'intarray' is whitelisted in target 2022-12-10 10:40:14,376 PGMigrate INFO Extension 'intarray' version '1.5' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,481 PGMigrate INFO Extension 'isn' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:14,481 PGMigrate INFO Extension 'isn' is whitelisted in target 2022-12-10 10:40:14,482 PGMigrate INFO Extension 'isn' version '1.2' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,586 PGMigrate INFO Extension 'ltree' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:14,586 PGMigrate INFO Extension 'ltree' is whitelisted in target 2022-12-10 10:40:14,586 PGMigrate INFO Extension 'ltree' version '1.2' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,688 PGMigrate INFO Extension 'pg_trgm' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:14,688 PGMigrate INFO Extension 'pg_trgm' is whitelisted in target 2022-12-10 10:40:14,688 PGMigrate INFO Extension 'pg_trgm' version '1.6' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,791 PGMigrate INFO Extension 'pgcrypto' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:14,791 PGMigrate INFO Extension 'pgcrypto' is whitelisted in target 2022-12-10 10:40:14,791 PGMigrate INFO Extension 'pgcrypto' version '1.3' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,889 PGMigrate INFO Extension 'seg' version '1.4' available for installation in target, source version: '1.4' 2022-12-10 10:40:14,889 PGMigrate INFO Extension 'seg' is trusted in target 2022-12-10 10:40:14,889 PGMigrate INFO Extension 'seg' version '1.4' will be installed in target database 'poll_service_production' 2022-12-10 10:40:14,990 PGMigrate INFO Extension 'unaccent' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:14,990 PGMigrate INFO Extension 'unaccent' is whitelisted in target 2022-12-10 10:40:14,990 PGMigrate INFO Extension 'unaccent' version '1.1' will be installed in target database 'poll_service_production' 2022-12-10 10:40:15,092 PGMigrate INFO Extension 'uuid-ossp' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:15,093 PGMigrate INFO Extension 'uuid-ossp' is whitelisted in target 2022-12-10 10:40:15,093 PGMigrate INFO Extension 'uuid-ossp' version '1.1' will be installed in target database 'poll_service_production' 2022-12-10 10:40:15,207 PGMigrate INFO Extension 'plpgsql' version '1.0' available for installation in target, source version: '1.0' 2022-12-10 10:40:15,208 PGMigrate INFO Extension 'plpgsql' is whitelisted in target 2022-12-10 10:40:15,208 PGMigrate INFO Extension 'plpgsql' version '1.0' will be installed in target database 'utility_service_production' 2022-12-10 10:40:15,316 PGMigrate INFO Extension 'btree_gin' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:15,317 PGMigrate INFO Extension 'btree_gin' is whitelisted in target 2022-12-10 10:40:15,317 PGMigrate INFO Extension 'btree_gin' version '1.3' will be installed in target database 'utility_service_production' 2022-12-10 10:40:15,425 PGMigrate INFO Extension 'btree_gist' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:15,426 PGMigrate INFO Extension 'btree_gist' is whitelisted in target 2022-12-10 10:40:15,426 PGMigrate INFO Extension 'btree_gist' version '1.6' will be installed in target database 'utility_service_production' 2022-12-10 10:40:15,528 PGMigrate INFO Extension 'citext' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:15,529 PGMigrate INFO Extension 'citext' is whitelisted in target 2022-12-10 10:40:15,529 PGMigrate INFO Extension 'citext' version '1.6' will be installed in target database 'utility_service_production' 2022-12-10 10:40:15,634 PGMigrate INFO Extension 'cube' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:15,634 PGMigrate INFO Extension 'cube' is whitelisted in target 2022-12-10 10:40:15,634 PGMigrate INFO Extension 'cube' version '1.5' will be installed in target database 'utility_service_production' 2022-12-10 10:40:15,738 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:15,738 PGMigrate INFO Extension 'fuzzystrmatch' is whitelisted in target 2022-12-10 10:40:15,738 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' will be installed in target database 'utility_service_production' 2022-12-10 10:40:15,838 PGMigrate INFO Extension 'hstore' version '1.8' available for installation in target, source version: '1.8' 2022-12-10 10:40:15,838 PGMigrate INFO Extension 'hstore' is whitelisted in target 2022-12-10 10:40:15,838 PGMigrate INFO Extension 'hstore' version '1.8' will be installed in target database 'utility_service_production' 2022-12-10 10:40:15,943 PGMigrate INFO Extension 'intarray' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:15,943 PGMigrate INFO Extension 'intarray' is whitelisted in target 2022-12-10 10:40:15,943 PGMigrate INFO Extension 'intarray' version '1.5' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,049 PGMigrate INFO Extension 'isn' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:16,049 PGMigrate INFO Extension 'isn' is whitelisted in target 2022-12-10 10:40:16,049 PGMigrate INFO Extension 'isn' version '1.2' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,153 PGMigrate INFO Extension 'ltree' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:16,154 PGMigrate INFO Extension 'ltree' is whitelisted in target 2022-12-10 10:40:16,154 PGMigrate INFO Extension 'ltree' version '1.2' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,257 PGMigrate INFO Extension 'pg_trgm' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:16,257 PGMigrate INFO Extension 'pg_trgm' is whitelisted in target 2022-12-10 10:40:16,258 PGMigrate INFO Extension 'pg_trgm' version '1.6' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,358 PGMigrate INFO Extension 'pgcrypto' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:16,358 PGMigrate INFO Extension 'pgcrypto' is whitelisted in target 2022-12-10 10:40:16,359 PGMigrate INFO Extension 'pgcrypto' version '1.3' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,463 PGMigrate INFO Extension 'seg' version '1.4' available for installation in target, source version: '1.4' 2022-12-10 10:40:16,463 PGMigrate INFO Extension 'seg' is trusted in target 2022-12-10 10:40:16,463 PGMigrate INFO Extension 'seg' version '1.4' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,568 PGMigrate INFO Extension 'unaccent' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:16,568 PGMigrate INFO Extension 'unaccent' is whitelisted in target 2022-12-10 10:40:16,568 PGMigrate INFO Extension 'unaccent' version '1.1' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,672 PGMigrate INFO Extension 'uuid-ossp' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:16,672 PGMigrate INFO Extension 'uuid-ossp' is whitelisted in target 2022-12-10 10:40:16,672 PGMigrate INFO Extension 'uuid-ossp' version '1.1' will be installed in target database 'utility_service_production' 2022-12-10 10:40:16,777 PGMigrate INFO Extension 'plpgsql' version '1.0' available for installation in target, source version: '1.0' 2022-12-10 10:40:16,778 PGMigrate INFO Extension 'plpgsql' is whitelisted in target 2022-12-10 10:40:16,778 PGMigrate INFO Extension 'plpgsql' version '1.0' will be installed in target database 'reff_service_production' 2022-12-10 10:40:16,882 PGMigrate INFO Extension 'btree_gin' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:16,882 PGMigrate INFO Extension 'btree_gin' is whitelisted in target 2022-12-10 10:40:16,882 PGMigrate INFO Extension 'btree_gin' version '1.3' will be installed in target database 'reff_service_production' 2022-12-10 10:40:16,989 PGMigrate INFO Extension 'btree_gist' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:16,989 PGMigrate INFO Extension 'btree_gist' is whitelisted in target 2022-12-10 10:40:16,989 PGMigrate INFO Extension 'btree_gist' version '1.6' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,090 PGMigrate INFO Extension 'citext' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:17,090 PGMigrate INFO Extension 'citext' is whitelisted in target 2022-12-10 10:40:17,090 PGMigrate INFO Extension 'citext' version '1.6' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,197 PGMigrate INFO Extension 'cube' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:17,197 PGMigrate INFO Extension 'cube' is whitelisted in target 2022-12-10 10:40:17,198 PGMigrate INFO Extension 'cube' version '1.5' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,303 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:17,303 PGMigrate INFO Extension 'fuzzystrmatch' is whitelisted in target 2022-12-10 10:40:17,304 PGMigrate INFO Extension 'fuzzystrmatch' version '1.1' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,409 PGMigrate INFO Extension 'hstore' version '1.8' available for installation in target, source version: '1.8' 2022-12-10 10:40:17,409 PGMigrate INFO Extension 'hstore' is whitelisted in target 2022-12-10 10:40:17,409 PGMigrate INFO Extension 'hstore' version '1.8' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,511 PGMigrate INFO Extension 'intarray' version '1.5' available for installation in target, source version: '1.5' 2022-12-10 10:40:17,512 PGMigrate INFO Extension 'intarray' is whitelisted in target 2022-12-10 10:40:17,512 PGMigrate INFO Extension 'intarray' version '1.5' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,615 PGMigrate INFO Extension 'isn' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:17,615 PGMigrate INFO Extension 'isn' is whitelisted in target 2022-12-10 10:40:17,615 PGMigrate INFO Extension 'isn' version '1.2' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,715 PGMigrate INFO Extension 'ltree' version '1.2' available for installation in target, source version: '1.2' 2022-12-10 10:40:17,715 PGMigrate INFO Extension 'ltree' is whitelisted in target 2022-12-10 10:40:17,715 PGMigrate INFO Extension 'ltree' version '1.2' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,822 PGMigrate INFO Extension 'pg_trgm' version '1.6' available for installation in target, source version: '1.6' 2022-12-10 10:40:17,822 PGMigrate INFO Extension 'pg_trgm' is whitelisted in target 2022-12-10 10:40:17,823 PGMigrate INFO Extension 'pg_trgm' version '1.6' will be installed in target database 'reff_service_production' 2022-12-10 10:40:17,930 PGMigrate INFO Extension 'pgcrypto' version '1.3' available for installation in target, source version: '1.3' 2022-12-10 10:40:17,930 PGMigrate INFO Extension 'pgcrypto' is whitelisted in target 2022-12-10 10:40:17,930 PGMigrate INFO Extension 'pgcrypto' version '1.3' will be installed in target database 'reff_service_production' 2022-12-10 10:40:18,039 PGMigrate INFO Extension 'seg' version '1.4' available for installation in target, source version: '1.4' 2022-12-10 10:40:18,039 PGMigrate INFO Extension 'seg' is trusted in target 2022-12-10 10:40:18,039 PGMigrate INFO Extension 'seg' version '1.4' will be installed in target database 'reff_service_production' 2022-12-10 10:40:18,142 PGMigrate INFO Extension 'unaccent' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:18,142 PGMigrate INFO Extension 'unaccent' is whitelisted in target 2022-12-10 10:40:18,142 PGMigrate INFO Extension 'unaccent' version '1.1' will be installed in target database 'reff_service_production' 2022-12-10 10:40:18,246 PGMigrate INFO Extension 'uuid-ossp' version '1.1' available for installation in target, source version: '1.1' 2022-12-10 10:40:18,246 PGMigrate INFO Extension 'uuid-ossp' is whitelisted in target 2022-12-10 10:40:18,246 PGMigrate INFO Extension 'uuid-ossp' version '1.1' will be installed in target database 'reff_service_production' 2022-12-10 10:40:18,353 PGMigrate INFO Extension 'plpgsql' version '1.0' available for installation in target, source version: '1.0' 2022-12-10 10:40:18,353 PGMigrate INFO Extension 'plpgsql' is whitelisted in target 2022-12-10 10:40:18,354 PGMigrate INFO Extension 'plpgsql' version '1.0' will be installed in target database 'iatros_sftp_production' 2022-12-10 10:40:18,456 PGMigrate INFO Extension 'plpgsql' version '1.0' available for installation in target, source version: '1.0' 2022-12-10 10:40:18,456 PGMigrate INFO Extension 'plpgsql' is whitelisted in target 2022-12-10 10:40:18,456 PGMigrate INFO Extension 'plpgsql' version '1.0' will be installed in target database 'randomization_production' 2022-12-10 10:40:18,736 PGMigrate INFO Logical replication available in source (14.5) 2022-12-10 10:40:18,736 PGMigrate INFO Source: max_replication_slots = 20, max_logical_replication_workers = 4, max_worker_processes = 8, wal_level = logical, max_wal_senders = 20 2022-12-10 10:40:18,736 PGMigrate INFO Target: max_replication_slots = 20, max_logical_replication_workers = 4, max_worker_processes = 8, wal_level = logical, max_wal_senders = 20 2022-12-10 10:40:18,737 PGMigrate INFO Using max 2 workers 2022-12-10 10:40:18,878 PGMigrate INFO Creating role PGRole(rolname='grafana', rolsuper=False, rolinherit=True, rolcreaterole=False, rolcreatedb=False, rolcanlogin=True, rolreplication=False, rolconnlimit=-1, rolpassword='placeholder_kqcundrqavunfmji', rolvaliduntil=None, rolbypassrls=False, rolconfig=[], safe_rolname='grafana') to target 2022-12-10 10:40:18,979 PGMigrate WARNING Role '_aiven' already exists in target 2022-12-10 10:40:18,979 PGMigrate WARNING Role 'avnadmin' already exists in target 2022-12-10 10:40:19,252 PGMigrate INFO Dumping schema from database 'defaultdb' 2022-12-10 10:40:19,353 PGMigrate INFO Dumping schema from database 'account_service_production' ERROR: database "defaultdb" already exists STATEMENT: CREATE DATABASE defaultdb WITH TEMPLATE = template0 ENCODING = 'UTF8' LOCALE = 'en_US.UTF-8'; 2022-12-10 10:40:20,367 PGTarget INFO no results to fetch 2022-12-10 10:40:20,742 PGSource INFO Creating publication 'aiven_db_migrate_defaultdb_pub' for all tables in database 'defaultdb', has_aiven_extras: False 2022-12-10 10:40:20,771 PGMigrate ERROR Encountered error: InsufficientPrivilege('must be superuser to create FOR ALL TABLES publication\n'), cleaning up 2022-12-10 10:40:20,772 PGMigrate WARNING Logical replication failed with error: 'must be superuser to create FOR ALL TABLES publication', fallback to dump 2022-12-10 10:40:20,772 PGMigrate INFO Dumping data from database 'defaultdb' 2022-12-10 10:40:21,057 PGMigrate INFO Dumping schema from database 'content_service_production' ERROR: must be owner of extension btree_gin STATEMENT: COMMENT ON EXTENSION btree_gin IS 'support for indexing common datatypes in GIN'; ERROR: must be owner of extension btree_gist STATEMENT: COMMENT ON EXTENSION btree_gist IS 'support for indexing common datatypes in GiST'; ERROR: must be owner of extension citext STATEMENT: COMMENT ON EXTENSION citext IS 'data type for case-insensitive character strings'; ERROR: must be owner of extension cube STATEMENT: COMMENT ON EXTENSION cube IS 'data type for multidimensional cubes'; ERROR: must be owner of extension fuzzystrmatch STATEMENT: COMMENT ON EXTENSION fuzzystrmatch IS 'determine similarities and distance between strings'; ERROR: must be owner of extension hstore STATEMENT: COMMENT ON EXTENSION hstore IS 'data type for storing sets of (key, value) pairs'; ERROR: must be owner of extension intarray STATEMENT: COMMENT ON EXTENSION intarray IS 'functions, operators, and index support for 1-D arrays of integers'; ERROR: must be owner of extension isn STATEMENT: COMMENT ON EXTENSION isn IS 'data types for international product numbering standards'; ERROR: must be owner of extension ltree STATEMENT: COMMENT ON EXTENSION ltree IS 'data type for hierarchical tree-like structures'; ERROR: must be owner of extension pg_trgm STATEMENT: COMMENT ON EXTENSION pg_trgm IS 'text similarity measurement and index searching based on trigrams'; ERROR: must be owner of extension pgcrypto STATEMENT: COMMENT ON EXTENSION pgcrypto IS 'cryptographic functions'; ERROR: must be owner of extension unaccent STATEMENT: COMMENT ON EXTENSION unaccent IS 'text search dictionary that removes accents'; ERROR: must be owner of extension uuid-ossp STATEMENT: COMMENT ON EXTENSION "uuid-ossp" IS 'generate universally unique identifiers (UUIDs)'; ERROR: must be owner of extension btree_gin STATEMENT: COMMENT ON EXTENSION btree_gin IS 'support for indexing common datatypes in GIN'; ERROR: must be owner of extension btree_gist STATEMENT: COMMENT ON EXTENSION btree_gist IS 'support for indexing common datatypes in GiST'; ERROR: must be owner of extension citext STATEMENT: COMMENT ON EXTENSION citext IS 'data type for case-insensitive character strings'; ERROR: must be owner of extension cube STATEMENT: COMMENT ON EXTENSION cube IS 'data type for multidimensional cubes'; ERROR: must be owner of extension fuzzystrmatch STATEMENT: COMMENT ON EXTENSION fuzzystrmatch IS 'determine similarities and distance between strings'; ERROR: must be owner of extension hstore STATEMENT: COMMENT ON EXTENSION hstore IS 'data type for storing sets of (key, value) pairs'; ERROR: must be owner of extension intarray STATEMENT: COMMENT ON EXTENSION intarray IS 'functions, operators, and index support for 1-D arrays of integers'; ERROR: must be owner of extension isn STATEMENT: COMMENT ON EXTENSION isn IS 'data types for international product numbering standards'; ERROR: must be owner of extension ltree STATEMENT: COMMENT ON EXTENSION ltree IS 'data type for hierarchical tree-like structures'; ERROR: must be owner of extension pg_trgm STATEMENT: COMMENT ON EXTENSION pg_trgm IS 'text similarity measurement and index searching based on trigrams'; ERROR: must be owner of extension pgcrypto STATEMENT: COMMENT ON EXTENSION pgcrypto IS 'cryptographic functions'; ERROR: must be owner of extension unaccent STATEMENT: COMMENT ON EXTENSION unaccent IS 'text search dictionary that removes accents'; ERROR: must be owner of extension uuid-ossp STATEMENT: COMMENT ON EXTENSION "uuid-ossp" IS 'generate universally unique identifiers (UUIDs)'; 2022-12-10 10:40:28,412 PGTarget INFO no results to fetch 2022-12-10 10:40:28,805 PGSource INFO Creating publication 'aiven_db_migrate_content_service_production_pub' for all tables in database 'content_service_production', has_aiven_extras: False 2022-12-10 10:40:28,848 PGMigrate ERROR Encountered error: InsufficientPrivilege('must be superuser to create FOR ALL TABLES publication\n'), cleaning up 2022-12-10 10:40:28,848 PGMigrate WARNING Logical replication failed with error: 'must be superuser to create FOR ALL TABLES publication', fallback to dump 2022-12-10 10:40:28,848 PGMigrate INFO Dumping data from database 'content_service_production' pg_dump: warning: there are circular foreign-key constraints among these tables: pg_dump: huey_monitor_signalinfomodel pg_dump: huey_monitor_taskmodel pg_dump: You might not be able to restore the dump without using --disable-triggers or temporarily dropping the constraints. pg_dump: Consider using a full dump instead of a --data-only dump to avoid this problem. pg_dump: warning: there are circular foreign-key constraints among these tables: pg_dump: oauth2_provider_accesstoken pg_dump: oauth2_provider_refreshtoken pg_dump: You might not be able to restore the dump without using --disable-triggers or temporarily dropping the constraints. pg_dump: Consider using a full dump instead of a --data-only dump to avoid this problem. pg_dump: warning: there are circular foreign-key constraints on this table: pg_dump: huey_monitor_taskmodel pg_dump: You might not be able to restore the dump without using --disable-triggers or temporarily dropping the constraints. pg_dump: Consider using a full dump instead of a --data-only dump to avoid this problem. 2022-12-10 10:40:29,803 PGTarget INFO no results to fetch ERROR: insert or update on table "huey_monitor_signalinfomodel" violates foreign key constraint "huey_monitor_signali_task_id_68fa68bd_fk_huey_moni" DETAIL: Key (task_id)=(27282c08-9502-404d-bb97-cd3329358967) is not present in table "huey_monitor_taskmodel". STATEMENT: COPY public.huey_monitor_signalinfomodel (id, signal_name, exception_line, exception, create_dt, task_id, hostname, pid, thread, progress_count) FROM stdin; ERROR: insert or update on table "huey_monitor_taskmodel" violates foreign key constraint "huey_monitor_taskmod_state_id_b20b1eca_fk_huey_moni" DETAIL: Key (state_id)=(b0312851-15be-4cad-a8a7-7b0ff49fea45) is not present in table "huey_monitor_signalinfomodel". STATEMENT: COPY public.huey_monitor_taskmodel (create_dt, update_dt, task_id, name, state_id, parent_task_id, "desc", total, unit, unit_divisor, finished, progress_count, cumulate_progress) FROM stdin; 2022-12-10 10:40:30,210 PGSource INFO Creating publication 'aiven_db_migrate_account_service_production_pub' for all tables in database 'account_service_production', has_aiven_extras: False 2022-12-10 10:40:30,235 PGMigrate ERROR Encountered error: InsufficientPrivilege('must be superuser to create FOR ALL TABLES publication\n'), cleaning up 2022-12-10 10:40:30,236 PGMigrate WARNING Logical replication failed with error: 'must be superuser to create FOR ALL TABLES publication', fallback to dump

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant