You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Parquet is a nice default for withStreamingInputTable as kinesis handles transforming JSON into parquet. There are npm libraries to do this conversion manually yourself, but it can be inconvenient. We should support other file formats so that it is easy to create something like a static fact table:
consttableArgs: TableArgs={
columns,format: "JSON"}constdataWarehouse=newServerlessDataWarehouse("analytics_dw").withTable(impressionsTableName,genericTableArgs)consts3Bucket=this.dataWarehouseBucket;// ... configure an s3 client with a connection to the bucket ...constdataFacts=[{ad: 1,author: "evan",date: "12/26/2019"},{ad: 2,author: "jordan",date: "12/27/2019}];s3Client.put(s3Path,JSON.stringify(dataFacts));
Now we have a table with a static JSON dataset that is uploaded at deployment time. Will also be useful for batch tables.
The text was updated successfully, but these errors were encountered:
Parquet is a nice default for
withStreamingInputTable
as kinesis handles transforming JSON into parquet. There are npm libraries to do this conversion manually yourself, but it can be inconvenient. We should support other file formats so that it is easy to create something like a static fact table:Now we have a table with a static JSON dataset that is uploaded at deployment time. Will also be useful for batch tables.
The text was updated successfully, but these errors were encountered: