Skip to content

Commit

Permalink
Merge branch 'main' into edgarrmondragon/feat/add-tap-fedidb
Browse files Browse the repository at this point in the history
  • Loading branch information
edgarrmondragon authored Sep 19, 2024
2 parents 9d0af69 + 54fbb91 commit ec23f9a
Show file tree
Hide file tree
Showing 30 changed files with 459 additions and 76 deletions.
10 changes: 10 additions & 0 deletions _data/meltano/extractors/tap-auth0/matatika.yml
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,8 @@ settings:
options:
- label: Jsonl
value: jsonl
- label: Parquet
value: parquet
- description: Prefix to use when writing batch files.
kind: string
label: Batch Config Storage Prefix
Expand All @@ -58,6 +60,14 @@ settings:
kind: string
label: Domain
name: domain
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand Down
5 changes: 5 additions & 0 deletions _data/meltano/extractors/tap-awin/gthesheep.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,11 @@ settings:
label: Lookback Days
name: lookback_days
value: 30
- description: Number of days to batch in a single request. Maximum is 31.
kind: integer
label: Request Batch Size Days
name: request_batch_size_days
value: 1
- description: The earliest transaction date to sync
kind: date_iso8601
label: Start Date
Expand Down
23 changes: 22 additions & 1 deletion _data/meltano/extractors/tap-bamboohr/autoidm.yml
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,8 @@ settings:
kind: array
label: Custom Reports
name: custom_reports
- description: ''
- description: Either `fail` or `ignore`. Determines behavior when fields returned
by API don't match fields specified in tap config.
kind: options
label: Field Mismatch
name: field_mismatch
Expand All @@ -73,6 +74,25 @@ settings:
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: Size of photos to return from the photos stream. Pixel size information
can be found in the [docs](https://documentation.bamboohr.com/reference/get-employee-photo-1)
kind: options
label: Photo Size
name: photo_size
options:
- label: Original
value: original
- label: Large
value: large
- label: Medium
value: medium
- label: Small
value: small
- label: Xs
value: xs
- label: Tiny
value: tiny
value: original
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
Expand All @@ -89,6 +109,7 @@ settings:
settings_group_validation:
- - auth_token
- field_mismatch
- photo_size
- subdomain
settings_preamble: ''
usage: ''
Expand Down
1 change: 1 addition & 0 deletions _data/meltano/extractors/tap-beautifulsoup/meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,7 @@ settings:
kind: object
label: Find All Kwargs
name: find_all_kwargs
value: {}
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand Down
2 changes: 1 addition & 1 deletion _data/meltano/extractors/tap-circle-ci/meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ settings:
kind: string
label: User Agent
name: user_agent
value: tap-circle-ci/0.2.2 Singer tap for the CircleCI API.
value: tap-circle-ci/0.3.2 Singer tap for the CircleCI API.
settings_group_validation:
- - org_slug
- token
Expand Down
8 changes: 8 additions & 0 deletions _data/meltano/extractors/tap-cloudwatch/meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -95,6 +95,14 @@ settings:
kind: date_iso8601
label: End Date
name: end_date
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand Down
54 changes: 45 additions & 9 deletions _data/meltano/extractors/tap-cqc-org-uk/birdiecare.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
capabilities:
- about
- batch
- catalog
- discover
- schema-flattening
Expand All @@ -18,6 +19,40 @@ pip_url: git+https://github.com/birdiecare/tap-cqc-org-uk.git
quality: silver
repo: https://github.com/birdiecare/tap-cqc-org-uk
settings:
- description: Compression format to use for batch files.
kind: options
label: Batch Config Encoding Compression
name: batch_config.encoding.compression
options:
- label: Gzip
value: gzip
- label: None
value: none
- description: Format to use for batch files.
kind: options
label: Batch Config Encoding Format
name: batch_config.encoding.format
options:
- label: Jsonl
value: jsonl
- label: Parquet
value: parquet
- description: Prefix to use when writing batch files.
kind: string
label: Batch Config Storage Prefix
name: batch_config.storage.prefix
- description: Root path to use when writing batch files.
kind: string
label: Batch Config Storage Root
name: batch_config.storage.root
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand All @@ -27,25 +62,26 @@ settings:
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: Partner Code
kind: string
label: Partner Code
name: partner_code
- description: Determines how much historical data will be extracted. Please be aware
that the larger the time period and amount of data, the longer the initial extraction
can be expected to take.
- description: The earliest CQC update to sync
kind: date_iso8601
label: Start Date
name: start_date
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability.
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
settings_group_validation: []
- description: The primary key for the CQC API service
kind: password
label: Subscription Key
name: subscription_key
sensitive: true
settings_group_validation:
- - subscription_key
settings_preamble: ''
usage: ''
variant: birdiecare
2 changes: 1 addition & 1 deletion _data/meltano/extractors/tap-dbt/meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ settings:
kind: string
label: User Agent
name: user_agent
value: tap-dbt/0.10.1.dev14+36d0c91 Singer tap for the dbt Cloud API.
value: tap-dbt/0.12.3.dev3+da3ee25 Singer tap for the dbt Cloud API.
settings_group_validation:
- - account_ids
- api_key
Expand Down
18 changes: 18 additions & 0 deletions _data/meltano/extractors/tap-decentraland-api/decentraland.yml
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,11 @@ settings:
label: Builder API URL
name: builder_api_url
value: https://builder-api.decentraland.org/v1
- description: Builder Asset Packs URL
kind: string
label: Builder Assetpacks URL
name: builder_assetpacks_url
value: https://builder-assetpacks-prd-bf9fae6.s3.amazonaws.com
- description: ''
kind: string
label: Catalysts Start Date
Expand Down Expand Up @@ -77,11 +82,19 @@ settings:
label: Places API URL
name: places_api_url
value: https://places.decentraland.org/api
- description: Max rows to fetch from profile changes stream
kind: integer
label: Profile Stream Max Rows
name: profile_stream_max_rows
- description: Scenes Per Run
kind: integer
label: Scenes Per Run
name: scenes_per_run
value: 2000
- description: Max rows to fetch from store changes stream
kind: integer
label: Store Stream Max Rows
name: store_stream_max_rows
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
Expand All @@ -96,6 +109,11 @@ settings:
label: Sync Content After
name: sync_content_after
value: 1680998400000
- description: World content server URL
kind: string
label: World Content Server URL
name: world_content_server_url
value: https://worlds-content-server.decentraland.org
settings_group_validation:
- []
settings_preamble: ''
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -18,22 +18,28 @@ pip_url: git+https://github.com/decentraland/tap-decentraland-thegraph.git
quality: silver
repo: https://github.com/decentraland/tap-decentraland-thegraph
settings:
- description: ''
kind: array
label: Account Subgraph Paths
name: account_subgraph_paths
value:
- mana-ethereum-mainnet
- mana-matic-mainnet
- description: The API URL.
kind: string
label: API URL
name: api_url
value: https://api.thegraph.com/subgraphs/name/decentraland/marketplace
value: https://subgraph.decentraland.org/marketplace
- description: Eth Collections Url
kind: string
label: Eth Collections URL
name: eth_collections_url
value:
https://api.thegraph.com/subgraphs/name/decentraland/collections-ethereum-mainnet
value: https://subgraph.decentraland.org/collections-ethereum-mainnet
- description: Eth Mana Holder URL
kind: string
label: Eth Mana Holder URL
name: eth_mana_holder_url
value: https://api.thegraph.com/subgraphs/name/decentraland/mana-ethereum-mainnet
value: https://subgraph.decentraland.org/mana-ethereum-mainnet
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand All @@ -47,7 +53,11 @@ settings:
kind: integer
label: Incremental Limit
name: incremental_limit
value: 50000
- description: ''
kind: integer
label: Max Rows Per Run
name: max_rows_per_run
value: 1000
- description: Poaps Details Url
kind: string
label: Poaps Details URL
Expand All @@ -62,17 +72,17 @@ settings:
kind: string
label: Polygon Collections URL
name: polygon_collections_url
value: https://api.thegraph.com/subgraphs/name/decentraland/collections-matic-mainnet
value: https://subgraph.decentraland.org/collections-matic-mainnet
- description: Polygon Mana Holder Url
kind: string
label: Polygon Mana Holder URL
name: polygon_mana_holder_url
value: https://api.thegraph.com/subgraphs/name/decentraland/mana-matic-mainnet
value: https://subgraph.decentraland.org/mana-matic-mainnet
- description: ''
kind: string
label: Rentals URL
name: rentals_url
value: https://api.thegraph.com/subgraphs/name/decentraland/rentals-ethereum-mainnet
value: https://subgraph.decentraland.org/rentals-ethereum-mainnet
- description: The start updated at date to use.
kind: integer
label: Start Updated At
Expand All @@ -86,6 +96,11 @@ settings:
kind: object
label: Stream Maps
name: stream_maps
- description: ''
kind: string
label: Subgraph URL
name: subgraph_url
value: https://subgraph.decentraland.org
settings_group_validation:
- []
settings_preamble: ''
Expand Down
4 changes: 4 additions & 0 deletions _data/meltano/extractors/tap-dynamics-finance/hotgluexyz.yml
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,10 @@ settings:
label: Client Secret
name: client_secret
sensitive: true
- description: ''
kind: string
label: Company
name: company
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand Down
35 changes: 35 additions & 0 deletions _data/meltano/extractors/tap-dynamodb/meltanolabs.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
capabilities:
- about
- batch
- catalog
- discover
- schema-flattening
Expand Down Expand Up @@ -55,6 +56,40 @@ settings:
label: AWS Session Token
name: aws_session_token
sensitive: true
- description: Compression format to use for batch files.
kind: options
label: Batch Config Encoding Compression
name: batch_config.encoding.compression
options:
- label: Gzip
value: gzip
- label: None
value: none
- description: Format to use for batch files.
kind: options
label: Batch Config Encoding Format
name: batch_config.encoding.format
options:
- label: Jsonl
value: jsonl
- label: Parquet
value: parquet
- description: Prefix to use when writing batch files.
kind: string
label: Batch Config Storage Prefix
name: batch_config.storage.prefix
- description: Root path to use when writing batch files.
kind: string
label: Batch Config Storage Root
name: batch_config.storage.root
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
Expand Down
Loading

0 comments on commit ec23f9a

Please sign in to comment.