[Feature Request] upload video one by one instead of downloading the whole playlist before upload

[orkeilius]

Problem

tubeup download the full playlist before uploading to archive.org

Why that a problem

tubeup make a huge cache file (~100gb for 70 videos in good quality) making it impractical for device/VPS with small storage

Fix

change the way upload_ia() get_resource_basenames() work

Note

• I'm going to try to fix it myself
• I don't know if it better to use an option or change it by default

[mrpapersonic]

this was discussed in #317 by me, I just don't really have much time or interest lately :/

addendum: Make sure to not change the functionality of get_resource_basenames or upload_ia since those are public API members. Ideally we would move the contents to a gen_resource_basenames function that is a generator instead of returning a list, and get_resource_basenames can simply be return list(gen_resource_basenames(...)) (or whichever type it returned before).

[brandongalbraith]

I think this is a great feature request, but this requires substantial effort to refactor the logic in the app to change how it operates against a target service. If someone wants to build it, they are welcome to do so, but do know not only does the logic need to be updated, tests must be written, they must pass, and @vxbinaca will need to sign off on merging and shipping. This is why this has not been done yet.

[vxbinaca]

yt-dlp --get-id [URL] > script.sh

insert tubeup (notice the space at the end) at the start of each line in script.sh

save the file, now run it

sh script.sh

theres your one at a time uploads.

tubeup download the full playlist before uploading to archive.org

Oh you want to do one video? Then do that one video you can get it's URL and do a single video.

I don't know if it better to use an option or change it by default

it is better to use as a flag do not submit something that changes the default behavior.

tubeup make a huge cache file (~100gb for 70 videos in good quality) making it impractical for device/VPS with small storage

Symlink it to larger storage, also consider not downloading entire playlists or just doing one video at a time.

[vxbinaca]

oh and this an an issue and you blanked it out not following the guidelines

[orkeilius]

The issue template for bug
it not like that knowing that a use the last version of tubeup or that I check the internet archive is going to be useful...

[vxbinaca]

Read my reply I've given you a solution to your use case, not a bug.

Follow the issue submission guidelines. You blanked it I closed it. Try again next time and next time follow the instructions.