Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Parquet Export Format to lino pull Command #310

Open
youen opened this issue Aug 28, 2024 · 0 comments
Open

Add Parquet Export Format to lino pull Command #310

youen opened this issue Aug 28, 2024 · 0 comments

Comments

@youen
Copy link
Collaborator

youen commented Aug 28, 2024

To enhance performance and reduce storage requirements, this sub-task involves adding support for exporting data in Parquet format as part of the lino pull command. (#309)

Tasks:

  • Integrate a library for Parquet serialization within the lino tool.
  • Implement logic to export the pulled data in Parquet format.
  • Add a --format parquet option to the lino pull command.
  • Ensure compatibility with existing flags and options in lino pull.
  • Write unit and integration tests to validate Parquet export functionality.
  • Update the documentation to include usage examples for Parquet format.

Acceptance Criteria:

  • The lino pull command exports data in Parquet format.
  • The Parquet export is compatible with relevant lino pull flags and options.
  • Documentation is updated with examples of Parquet format usage.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant