You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for all of your work on nextflow! As best I can tell from the docs, the disk directive is not implemented with the local executor. Is this accurate? I very naively thought local would have been the first executor for it to be implemented only to realize later that it wasn't having any impact on my workflow (as far as I can tell). This directive would likely be very useful to the community for processing big data.
Without a full appreciation for how the directive is implemented on other platforms, I would think we could call something similar to https://unix.stackexchange.com/a/6014 in .command.run and error if there is not sufficient disk space? Thanks as always for your consideration!
The text was updated successfully, but these errors were encountered:
I think we could use df to get the available disk space at the start of a run. The local executor already does a similar thing with memory. But local doesn't actually limit the memory usage of each task, it just keeps track of how much memory it has allocated against the total and blocks pending tasks accordingly. This seems like a reasonable heuristic to use for disk space
New feature
Thanks for all of your work on nextflow! As best I can tell from the docs, the
disk
directive is not implemented with thelocal
executor. Is this accurate? I very naively thought local would have been the first executor for it to be implemented only to realize later that it wasn't having any impact on my workflow (as far as I can tell). This directive would likely be very useful to the community for processing big data.Without a full appreciation for how the directive is implemented on other platforms, I would think we could call something similar to https://unix.stackexchange.com/a/6014 in
.command.run
and error if there is not sufficient disk space? Thanks as always for your consideration!The text was updated successfully, but these errors were encountered: