psyduck is a WIP extensible ETL engine, previously written in typescript that aims to be extensible and fast
Psyduck is at MVP stage! The current feature TODO looks like
[x]some config loading ( yaml works for now! )[x]core pipeline builder + runner[x]plugin loader + exposed SDK tools for building plugiins[x]many producers -> many transformers -> many consumers[x]describe producers from producers[x]a standard library[x]a DSL for describing pipelines using HCL[x]loading compiled plugins @ runtime[ ]listen for new pipelines via http ( maybe? )[ ]psyduck node distributing pipeline work ( also maybe? )