add batch property to model jinja fnction #6590
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
github-actions
bot
added
Docs team
| | Property | Description | Example | | ||
| | -------- | ----------- | ------- | | ||
| | `id` | The unique identifier for the batch within the context of the microbatch model. | `model.batch.id` | | ||
| | `event_time_start` | The start time of the batch's [`event_time`](/reference/resource-configs/event-time) filter (inclusive). | `model.batch.event_time_start` | |
There was a problem hiding this comment.
@QMalcolm what do we mean by 'inclusive' and 'exclusive' here?
There was a problem hiding this comment.
@mirnawong1 great question ❤️
Short answer
Inclusive means the value is included in the batch, exclusive means the value is excluded from the batch
Long answer
To think specifically about inclusivity/exclusivity means with regard to a batch, consider the batch filter statement
WHERE event_time >= event_time_start AND event_time < event_time_end
Things to note
- The comparison of
event_timetoevent_time_startused>=with the=part of the operator including theevent_time_startas part of the range. This means the usage ofevent_time_startis inclusive in the range selection - In the comparison of
event_timetoevent_time_endwe used<meaning things up to, but not equal to, theevent_time_endwill be selected as part of the range. This means thatevent_time_endis exclusive in the range selection.
There was a problem hiding this comment.
oh got it, thanks so much for taking the time to clarify 🙏
|
|
||
| ### Usage notes | ||
|
|
||
| `model.batch` is only available during the execution of a microbatch model batch. Outside of the microbatch execution, `model.batch` is `None`, and its sub-properties aren't accessible. |
There was a problem hiding this comment.
We sort of state this above. Maybe we could combine the two into a callout if it's important enough
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
Co-authored-by: Matt Shaver <[email protected]>
|
Check your created Crawler Check your created index on your Algolia Application |
this pr adds a new
batchobject to the already existing model dbt-jinja-functions.The batch qualities available are:
id (i.e. model.batch.id)
This is the "unique" id for the batch within the context of the microbatch model
event_time_start (i.e. model.batch.event_time_start)
This is the start time of the batch's event time filter (inclusive)
event_time_end (i.e. model.batch.event_time_end)
This is the end time of the batch's event_time_filter (exclusive
Resolves #6585
🚀 Deployment available! Here are the direct links to the updated files: