Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snakemake version >=6.5 does not schedule jobs optimally #69

Open
pontushojer opened this issue Oct 2, 2023 · 0 comments
Open

Snakemake version >=6.5 does not schedule jobs optimally #69

pontushojer opened this issue Oct 2, 2023 · 0 comments

Comments

@pontushojer
Copy link
Collaborator

This issue was observed for the rule map_sort_ema_bins. It uses 4 cores per job so when 20 cores are available on a node one would expect 5 parallel jobs being running. However instead only one job is run at the time leaving 16 cores unused. I am not sure what the sources of the issue is but it seems that something in the snakemake scheduler was updated that causes this issue.

Tested snakemake versions which show the problem: v6.5.0, v6.5.1, v6.5.2, v6.5.3, v6.6.1, v6.8.1

The latest tested version that worked as expected was v6.4.1.

Issue copied from FrickTobias/BLR#244

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant