Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CHORE] Complete removal of fsspec #1448

Closed
wants to merge 5 commits into from

Conversation

jaychia
Copy link
Contributor

@jaychia jaychia commented Sep 26, 2023

Removes all user-facing fsspec APIs.

After this PR, we no longer need fsspec as a dependency.

  1. Removes the fs= kwarg from:
    a. daft.read_parquet
    b. daft.read_json
    c. daft.read_csv
  2. As a result, the fs kwarg is also removed in all downstream APIs.
  3. We also deprecate and remove the use of StorageConfig which used to help us pass along fsspec-parametrized IO configurations. Now we just use a naked IOConfig object.

@github-actions github-actions bot added the chore label Sep 26, 2023
@jaychia jaychia force-pushed the jay/remove-fsspec-user-facing-api branch 2 times, most recently from 7aae8b8 to 0ab356a Compare October 4, 2023 01:31
@jaychia jaychia force-pushed the jay/remove-fsspec-user-facing-api branch from 0ab356a to 9c7f431 Compare October 4, 2023 15:40
@jaychia jaychia changed the title [CHORE] Remove user-facing fsspec APIs [CHORE] Complete removal of fsspec Oct 4, 2023
@jaychia
Copy link
Contributor Author

jaychia commented Oct 26, 2023

Closing this branch until we decide to completely eliminate non-native reads

@jaychia jaychia closed this Oct 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant