Cache non-finished pipeline models to prevent loss of data when crash #385
Labels
component: ldio
Issues related to Linked Data Interactions
enhancement
New feature or request
move to JIRA
Is your feature request related to a problem? Please describe.
To prevent data loss, a solution needs to be put into place that caches models that are inside the LDIO pipelines
Describe the solution you'd like
Usage of Redis DB that will, on ingest save the member whilst on output delete the member again.
Should first replay members that are in cache on reboot.
The text was updated successfully, but these errors were encountered: