Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eliminate duplicate chunk downloads using recipes #40

Open
bgilbert opened this issue May 25, 2013 · 0 comments
Open

Eliminate duplicate chunk downloads using recipes #40

bgilbert opened this issue May 25, 2013 · 0 comments

Comments

@bgilbert
Copy link
Contributor

Allow packages to contain "recipe" metadata giving hashes of memory and disk image chunks. Use the recipe on the client to avoid redundant chunk downloads, e.g. by finding an identical chunk cached from another VM. Demand-fetch recipe chunks to avoid excessive up-front download cost.

For this to be useful, there must be low overhead and significant intra- or inter-VM redundancy. Consider selectively enabling recipe processing based on bandwidth and round-trip latency to the server. Investigate the amount of redundancy remaining after xz memory image compression (probably none) and qcow2 disk image compression.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant