Skip to content

Commit

Permalink
Clarify GCS
Browse files Browse the repository at this point in the history
  • Loading branch information
jochenchrist committed Aug 11, 2024
1 parent 42d8e49 commit 75d08c1
Showing 1 changed file with 17 additions and 15 deletions.
32 changes: 17 additions & 15 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -373,34 +373,36 @@ This object _MAY_ be extended with [Specification Extensions](#specification-ext
| format | `string` | Format of files, such as `parquet`, `delta`, `json`, `csv` |
| delimiter | `string` | (Only for format = `json`), how multiple json documents are delimited within one file, e.g., `new_line`, `array` |

Example:
Example (AWS S3):

```yaml
servers:
production:
type: s3
location: s3://acme-orders-prod/orders/
format: json
delimiter: new_line
```
#### AWS Glue Server Object
Example (MinIO):
| Field | Type | Description |
|----------|----------|------------------------------------------------------------|
| type | `string` | `glue` |
| account | `string` | REQUIRED. The AWS account, e.g., `1234-5678-9012` |
| database | `string` | REQUIRED. The AWS Glue Catalog database |
| location | `string` | URI location of the Glue Database |
| format | `string` | Format of files, such as `parquet`, `delta`, `json`, `csv` |
```yaml
servers:
minio:
type: s3
endpointUrl: http://localhost:9000
location: s3://my-bucket/path/
format: delta
```
Example:
Example (Google Cloud Storage):
```yaml
servers:
production:
type: glue
account: "1234-5678-9012"
database: acme-orders
location: s3://acme-orders-prod/orders/
gcs:
type: s3
endpointUrl: https://storage.googleapis.com
location: s3://my-bucket/path/*/*/*/*/*.parquet
format: parquet
```
Expand Down

0 comments on commit 75d08c1

Please sign in to comment.