Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable decommission for non-spot pools #119

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

88manpreet
Copy link
Contributor

Decommission feature makes sense only for spot pools.
There have been issues seen in the past for on-demand pools where the spark executors were running for long-time even if there are no active tasks, leading to hanging jobs

This has potentially been linked to decommission feature.

There shouldn't be any downside of disabling this feature for non-spot pools.

@CaptainSame
Copy link
Contributor

I think you need to pull master and resolve conflicts. I'll review again

@88manpreet 88manpreet force-pushed the d/manpreet/MLCOMPUTE-744_disable_decommission_non_batch_pools branch from 9407cd1 to 156ab0e Compare August 3, 2023 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants