Allow the user to specify the column name for snowplow_incremental
logic
#70
Labels
category:macros
Related to the macros in the package.
type:enhancement
New features or improvements to existing features.
Describe the feature
With the
snowplow_incremental
logic, users aren't able to specify which column should be used to see which data has been processed. Theis_run_with_new_events
macro is currently hardcoded to look forstart_tstamp
, however technically this could be any timestamp column. We should allow users to specify which column they want to point to to see which events have been processed already.Proposed Solution
In
macros/utils/is_run_with_new_events.sql
we should replacestart_tstamp
with a parameter such as{{ start_timestamp }}
which should take on a default value ofstart_tstamp
but could be specified by the user in theis_run_with_new_events
macro call. We should also create a test to ensure that this is working as expected with custom column names.The text was updated successfully, but these errors were encountered: