Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release BQ extension and scripts #2158

Merged
merged 5 commits into from
Aug 15, 2024
Merged

Release BQ extension and scripts #2158

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
db5b1b9
Merge pull request #2156 from firebase/master
cabljac Aug 14, 2024
800db00
fix(firestore-bigquery-export): fix vulns with extension and script
cabljac Aug 13, 2024
3129cf5
Merge pull request #2152 from firebase/@invertase/fix-bq-vulns-split
cabljac Aug 15, 2024
0a1a5e9
chore(firestore-bigquery-export): update lockfiles
cabljac Aug 15, 2024
38a0c81
Merge pull request #2159 from firebase/@invertase/update-package-locks
cabljac Aug 15, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions firestore-bigquery-export/CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
## Version 0.1.53

fixed - bump changetracker to fix npm vulnerabilities

## Version 0.1.52

fixed - bump changetracker to fix npm vulnerabilities
Expand Down
2 changes: 1 addition & 1 deletion firestore-bigquery-export/extension.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
# limitations under the License.

name: firestore-bigquery-export
version: 0.1.52
version: 0.1.53
specVersion: v1beta

displayName: Stream Firestore to BigQuery
Expand Down
11 changes: 7 additions & 4 deletions firestore-bigquery-export/functions/__tests__/e2e.test.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,16 @@ import * as admin from "firebase-admin";
import { BigQuery } from "@google-cloud/bigquery";

/** Set defaults */
const bqProjectId = "extensions-testing";
const bqProjectId = "dev-extensions-testing";
const datasetId = "firestore_export";
const tableId = "bq_e2e_test_raw_changelog";

/** Init resources */
admin.initializeApp({ projectId: bqProjectId });
const bq = new BigQuery({ projectId: "extensions-testing" });
const bq = new BigQuery({
projectId: "dev-extensions-testing",
// location: "us-central1",
});
import { documentData } from "./fixtures/documentData";

/***
Expand All @@ -27,7 +30,7 @@ describe("e2e", () => {
const docRef = await db.collection("posts").add(testData);

/** Wait for 20 seconds */
await new Promise((resolve) => setTimeout(resolve, 5000));
await new Promise((resolve) => setTimeout(resolve, 20000));

/** Get the latest record from this table */
const [changeLogQuery] = await bq.createQueryJob({
Expand Down Expand Up @@ -57,5 +60,5 @@ describe("e2e", () => {
expect(result.singleReference).toBe("reference/reference1");
expect(result.reference_list[0]).toBe("reference/reference1");
expect(result.reference_list[1]).toBe("reference/reference2");
}, 10000);
}, 30000);
});
13 changes: 7 additions & 6 deletions firestore-bigquery-export/functions/package-lock.json
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion firestore-bigquery-export/functions/package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
"author": "Jan Wyszynski <[email protected]>",
"license": "Apache-2.0",
"dependencies": {
"@firebaseextensions/firestore-bigquery-change-tracker": "^1.1.35",
"@firebaseextensions/firestore-bigquery-change-tracker": "^1.1.36",
"@google-cloud/bigquery": "^7.6.0",
"@types/chai": "^4.1.6",
"@types/express-serve-static-core": "4.17.30",
Expand Down
85 changes: 48 additions & 37 deletions firestore-bigquery-export/scripts/gen-schema-view/package-lock.json
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions firestore-bigquery-export/scripts/gen-schema-view/package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@firebaseextensions/fs-bq-schema-views",
"version": "0.4.7",
"version": "0.4.8",
"description": "Generate strongly-typed BigQuery Views based on raw JSON",
"main": "./lib/index.js",
"repository": {
Expand Down Expand Up @@ -31,7 +31,7 @@
"author": "Jan Wyszynski <[email protected]>",
"license": "Apache-2.0",
"dependencies": {
"@firebaseextensions/firestore-bigquery-change-tracker": "^1.1.33",
"@firebaseextensions/firestore-bigquery-change-tracker": "^1.1.36",
"@google-cloud/bigquery": "^6.0.3",
"commander": "5.0.0",
"firebase-admin": "^12.1.0",
Expand Down
Loading
Loading