Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removing files after upload to AWS S3, fails on windows #2591

Closed
Ruprect opened this issue Aug 22, 2019 · 4 comments
Closed

Removing files after upload to AWS S3, fails on windows #2591

Ruprect opened this issue Aug 22, 2019 · 4 comments

Comments

@Ruprect
Copy link

Ruprect commented Aug 22, 2019

On Windows, when I select to delete local files after upload to AWS S3, I get an error:

[2019-08-22 13:11:40] INFO: HTML stored in /sitespeed.io/sitespeed-result/www.sitespeed.io/2019-08-22-13-11-21
[2019-08-22 13:11:40] INFO: Uploading /sitespeed.io/sitespeed-result/www.sitespeed.io/2019-08-22-13-11-21 to S3 bucket signatours-sitespeed-io, this can take a while ...
[2019-08-22 13:11:44] INFO: Finished upload to s3
[2019-08-22 13:11:48] ERROR: Could not upload to S3 Error: ENOTEMPTY: directory not empty, rmdir '/sitespeed.io/sitespeed-result/www.sitespeed.io/2019-08-22-13-11-21/logs''

So directory cannot be deleted. If I elect to keep files on local machine, no problem.

This is the command used to run:

docker run --rm -v D:\git\repos\docker\sitespeed.io:/sitespeed.io sitespeedio/sitespeed.io:9.8.1 https://www.sitespeed.io/ --config config/config.json --n 1

And the versions used:

Google Chrome 76.0.3809.87
Mozilla Firefox 68.0
[2019-08-22 13:11:21] INFO: Versions OS: linux 4.9.184-linuxkit nodejs: v10.13.0 sitespeed.io: 9.8.1 browsertime: 5.7.3 coach: 3.6.0
@Ruprect Ruprect changed the title Removing files after upload fails on windows Removing files after upload to AWS S3, fails on windows Aug 22, 2019
@sumeetrohra
Copy link
Contributor

@Ruprect @soulgalore This is an issue with the fs-extra library. below are the issues I found in their repo:
jprichardson/node-fs-extra#590
jprichardson/node-fs-extra#532
so we can either wait for them to resolve this issue or we might have to find some other way to do this.

@soulgalore
Copy link
Member

Ah thanks @sumeetrohra !

@Ruprect if you don't mount any volume (like -v D:\git\repos\dock...) does it work then? Thinking that if you send the files to S3, you may not need them outside of the container, and then there may not be any permission issues deleting it?

@soulgalore
Copy link
Member

I wonder if this works now with the root fix in #2710 ?

@soulgalore soulgalore added the s3 AWS S3 label Jun 25, 2020
@soulgalore
Copy link
Member

I think this has been fixed as in https://github.com/sitespeedio/sitespeed.io/issues?page=6&q=is%3Aissue+is%3Aopen#issuecomment-554802351 - please let me know if I should re-open.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants