Code

Source: files (s3 and local)#653

Code

Merged

daniil-quix merged 24 commits intomainquixio/quix-streams:mainfrom source/blob_storequixio/quix-streams:source/blob_storeCopy head branch name to clipboardDec 3, 2024

+617-169

Commits

Commits on Dec 2, 2024

• initial commit, try to fix pickling error

  tim-quix

  committed
  c66e2a5

• fixed issue around pickling, need to simplify file gathering and partition counting

  tim-quix

  committed
  6389fcd

• created more shared methods and unified classes more

  tim-quix

  committed
  fa4ad96

• a few more tweaks

  tim-quix

  committed
  9045a00

• move everything to file source

  tim-quix

  committed
  6fee37d

• remove previous blob_store addition

  tim-quix

  committed
  5dd5d98

• clean up some things, add pagination handling to azure

  tim-quix

  committed
  dae3fc6

• add docs, rename some stuff

  tim-quix

  committed
  211b3cd

• clean up schema doc section

  tim-quix

  committed
  e23fc57

• clean up compressor

  tim-quix

  committed
  71792df

• tiny doc tweaks

  tim-quix

  committed
  4c3e6c3

• changes based on code review

  tim-quix

  committed
  8cff599

• Update docs/connectors/sources/aws-s3-file-source.md

  Show description for 8a699ac
  

  tim-quix

  and

  gwaramadze

  committed
  8a699ac

• change bucket variable name

  tim-quix

  committed
  c26a217

• update local file docs

  tim-quix

  committed
  bb12e07

• add azure docs

  tim-quix

  committed
  07af800

• clean up azure stuff and other small tweaks

  tim-quix

  committed
  72cba51

• clean up after second round of code review

  tim-quix

  committed
  f581e28

• doc inclusions and cleanup

  tim-quix

  committed
  4726928

• some tweaks for consistency across source and sink

  tim-quix

  committed
  5331152

• adjust replay to only sleep with large enough deltas

  tim-quix

  committed
  bd1bdff

Commits on Dec 3, 2024

• adjust replay speed to accept floats rather than a bool

  tim-quix

  committed
  2c8483b

• remove azure stuff

  tim-quix

  committed
  5a2e771

• fix a doc ref

  tim-quix

  committed
  e248f0c