Replies: 3 comments
-
|
Some more thoughts on this. |
Beta Was this translation helpful? Give feedback.
-
|
Hi, we're happy with the existing concurrency implementation. Thank you for the suggestion! |
Beta Was this translation helpful? Give feedback.
-
|
I'm happy for you. Does it mean the problem I described has a solution, or at least a better workaround, though? |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Problem
If the number of persistent tasks to run exceeds the default concurrency limit, turbo will refuse to run them unless you override the concurrency limit, which is likely to negatively affect the scheduling of non-persistent tasks.
Background
When you have a number of persistent tasks to start, you always expect that all of them are started eventually. If they're affected by the concurrency limit, this expectation is not met, and the only workaround is to increase the concurrency limit. This workaround leads to a problem, though, because if the limit has to be increased to accommodate for the number of persistent tasks, it means it can't be used effectively for its primary purpose, which is efficient scheduling of resource-bound tasks that are expected to complete.
Proposal
I propose to exclude persistent tasks from the concurrency limit. Ideally, they would be ignored for the purpose of concurrent scheduling of non-persistent tasks.
Beta Was this translation helpful? Give feedback.
All reactions