Fix up and add flexibility to HTCManager #157
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Currently, HTCManager is pretty rigid in terms of the job submission script and worker node script, and doesn't communicate properly as noted in #150 and #107.
To address the first, I added parameters that let one send extra inputs to the worker node, insert lines/ClassAds in the job submission script, add extra commands before julia is invoked on the worker node, and modify the location/command used in place of
telnet
. So one can do something likeand
addprocs(HTCManager(8))
behaves as before.To address the second, I made the master instance of julia bind to
0.0.0.0
, as suggested in #107 (and explained in JuliaParallel/MPI.jl#222). I have the impression that most HTCondor worker processes are not on the submission/login node, so I guess the new binding address should be the default, though I defer to others on this.