Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluate external 3rd party data stores like STFC/IRIS echo and DynaFed for user data. #297

Closed
Zarquan opened this issue Dec 15, 2020 · 3 comments
Assignees

Comments

@Zarquan
Copy link
Collaborator

Zarquan commented Dec 15, 2020

If our users can read and write data from an external archive, S3, VOSpace or Rucio, then we don't need to implement the user data management side ourselves.

@Zarquan Zarquan self-assigned this Dec 15, 2020
@Zarquan
Copy link
Collaborator Author

Zarquan commented Dec 15, 2020

If we provide the tools to import and export data to/from an external S3 service, then our users can store their data in that.

  • UK users who have accounts on the STFC/IRIS echo and DynaFed services can store their data there.
  • Other users can create an Amazon S3 account and store their data there.

All we would need to provide would be how-to instruction manuals "how to export your data to your DynaFed account" and "how to export your data to your Amazon S3 account".

@Zarquan
Copy link
Collaborator Author

Zarquan commented Dec 15, 2020

Simple implementation would be to use the S3 command line client from a %sh notebook to push/pull data from an external S3 service. To develop this we would need accounts on the target services and document how to use them.

  1. A test account on Amazon S3
  2. A test account on the IRIS echo service

@Zarquan
Copy link
Collaborator Author

Zarquan commented Feb 25, 2021

Duplicate of #246.

@Zarquan Zarquan closed this as completed Feb 25, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant