Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V1 of bringing everything together #19

Merged
merged 6 commits into from
May 7, 2024
Merged

Conversation

stuartlynn
Copy link
Contributor

@stuartlynn stuartlynn commented Apr 29, 2024

This PR has the starting point of bringing the different threads together

  • Makes everything async.
  • Maps the CLI data command into a DataRequest
  • Uses this DataRequest along with the Metadata Catalogue to get the locations of the metrics and geoms
  • Call the methods to get the geometries and metrics
  • Join them together and return as a DataFrame

Work still to be done that is probably for future PR's and issues.

  1. Align with the new metadata model
  2. Explore accessing the different metric files in parallel to speed up fetches.
  3. Figure out how the survey is selected / inferred.
  4. How do we align async with wasm?

@stuartlynn stuartlynn changed the title WIP: V1 of bringing everything together V1 of bringing everything together Apr 30, 2024
@stuartlynn stuartlynn requested a review from yongrenjie April 30, 2024 08:58
src/lib.rs Outdated Show resolved Hide resolved
src/lib.rs Show resolved Hide resolved
@yongrenjie yongrenjie merged commit ccbed08 into main May 7, 2024
1 check passed
@yongrenjie
Copy link
Contributor

Okay, I'm going to try to put together a dataset that obeys the metadata schema asap and we can go from there.

@yongrenjie yongrenjie deleted the combine_geoms_and_metrics branch May 30, 2024 15:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done:
Development

Successfully merging this pull request may close these issues.

2 participants