Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test suite: home for PCAPs #519

Closed
mmguero opened this issue Dec 2, 2024 · 1 comment
Closed

test suite: home for PCAPs #519

mmguero opened this issue Dec 2, 2024 · 1 comment
Assignees
Labels
github Dealing with Malcolm's GitHub repository testing Related to automated system testing of Malcolm
Milestone

Comments

@mmguero
Copy link
Collaborator

mmguero commented Dec 2, 2024

Part of the automated testing framework is, of course, the artifacts that are used to populate a Malcolm system to be able to have data to run tests against. In other words, PCAP.

GitHub has some limits on large files, and for good reason, because managing binary files, especially large ones, does not work well within Git. The solution for this is Git LFS (large file storage), which is not a GitHub-specific technology (it can be deployed on other git servers locally or wherever), but it is a (paid, at the volume we would need) service that GitHub offers. GitHub does offer free Git LFS but it's fairly limited for our needs.

I'm going to make the automated testing framework as flexible as possible (supporting getting the PCAP data set from a number of places, I think), but for the "canonical" location for storing the PCAP files we need to come up with some place. I am looking into cisagov's GitHub account (i'll look at idaholabs, as well) if it is already paying for Git LFS, and if so, could we use it, and if so, what would the limits be, etc.

Another possible option might be something like backblaze which is reasonably priced.

@mmguero mmguero added enhancement New feature or request testing Related to automated system testing of Malcolm labels Dec 2, 2024
@mmguero mmguero self-assigned this Dec 2, 2024
@mmguero mmguero added github Dealing with Malcolm's GitHub repository and removed enhancement New feature or request labels Dec 2, 2024
@mmguero mmguero added this to Malcolm Dec 2, 2024
@mmguero mmguero added this to the v24.12.0 milestone Dec 2, 2024
@mmguero mmguero moved this to In Progress in Malcolm Dec 2, 2024
@mmguero
Copy link
Collaborator Author

mmguero commented Dec 11, 2024

Although it wasn't my first choice, after coming across some difficulties/complications with trying to fund GitHub's Git-LFS, we've just created a regular git repository called Malcolm-Test-Artifacts where we're housing the artifacts. We want to be judicious about the volume of data we store here, but I think it will be sufficient for now. We may revisit in the future with a more robust solution.

@mmguero mmguero closed this as completed Dec 11, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in Malcolm Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
github Dealing with Malcolm's GitHub repository testing Related to automated system testing of Malcolm
Projects
Status: Done
Development

No branches or pull requests

1 participant