Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add recursive finder for filelike objects #266

Merged
merged 7 commits into from
Apr 5, 2024
Merged

Add recursive finder for filelike objects #266

merged 7 commits into from
Apr 5, 2024

Conversation

JSKenyon
Copy link
Collaborator

(Hopefully) does what it says on the tin. As @o-smirnov points out, this may be somewhat error prone. That said, I have added a handful of tests and the pipeline which originally identified the problem now runs through. In principle, the code could be further refined (the typeguard package seems to be very useful), but I think that this should be enough for now. If more exotic types foil this approach, we can always add them to the test suite and iterate.

@JSKenyon JSKenyon requested a review from o-smirnov March 26, 2024 14:41
@JSKenyon
Copy link
Collaborator Author

Requires #268.

@JSKenyon
Copy link
Collaborator Author

@o-smirnov Tests are now passing (rebased on master after dropping 3.7). Feel free to add/change at your leisure.

@o-smirnov
Copy link
Member

OK, I also added the following option to allow explicit user-specified binding of directories. Simple enough change.

opts:
  backend:
    singularity:
      bind_dirs:
        ~/tmp: rw
        /tmp: ro 

@JSKenyon if the pipeline is in front of you now, could you please test this quickly?

@JSKenyon
Copy link
Collaborator Author

@JSKenyon if the pipeline is in front of you now, could you please test this quickly?

In progress. Have disabled my file finder and I am instead mounting everything manually. Will let you know once it runs through.

@JSKenyon
Copy link
Collaborator Author

@o-smirnov That seems to have worked. The combination of the finder and the override should be pretty foolproof.

Copy link
Member

@o-smirnov o-smirnov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@Athanaseus Athanaseus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@o-smirnov o-smirnov merged commit 7a28ba5 into master Apr 5, 2024
3 checks passed
@o-smirnov o-smirnov deleted the file_finder branch April 5, 2024 18:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants