Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implementations? #4

Open
delaneyj opened this issue Sep 8, 2023 · 3 comments
Open

Implementations? #4

delaneyj opened this issue Sep 8, 2023 · 3 comments

Comments

@delaneyj
Copy link

delaneyj commented Sep 8, 2023

Question

Iceberg has subprojects targetting arrow/orc/parquet/etc. Is there plans to have adapters be part of this repo?

Are there plans to have interfaces for SchemaToDatastore?

@zeroshade
Copy link
Member

I plan on supporting Arrow, Parquet, Avro and Orc in this repo as much as I can.

That said, I'm not familiar with SchemaToDatastore, but I want to support as much as possible in this library.

@delaneyj
Copy link
Author

delaneyj commented Sep 8, 2023

Oh its not a library, I meant include an interface to be able to plugin any of these options or others. Is there a timeline for Parquet?

@zeroshade
Copy link
Member

There isn't a timeline currently as I'm very limited by the bandwidth of available Iceberg committers with the time (and ability) to review the Go code and actually merge the commits. Though I have the majority of work through a working REST catalog that can read the metadata already sketched out. Actually fetching the data from parquet files would be next on the list after that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants