Is it possible to adjust the concurrency level for the batch processing during the application's operation? #16111

Closed
opened 2026-02-21 19:24:41 -05:00 by yindo · 1 comment
Owner

Originally created by @silence-pan84 on GitHub (Aug 12, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Is it possible to adjust the concurrency level for the batch processing during the application's operation?

Image The concurrency of this part is 5. Can it be adjusted?

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @silence-pan84 on GitHub (Aug 12, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. Is it possible to adjust the concurrency level for the batch processing during the application's operation? <img width="597" height="484" alt="Image" src="https://github.com/user-attachments/assets/75dc4d49-ad70-4a63-98f8-a4f52ca92f63" /> The concurrency of this part is 5. Can it be adjusted? ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancementfeat:webapp labels 2026-02-21 19:24:41 -05:00
yindo closed this issue 2026-02-21 19:24:41 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Aug 12, 2025):

It's not currently possible to adjust the concurrency level for batch processing dynamically while Dify is running. The concurrency is controlled by parameters like SERVER_WORKER_AMOUNT, SERVER_WORKER_CONNECTIONS, APP_MAX_ACTIVE_REQUESTS, thread pool size, and WORKFLOW_PARALLEL_DEPTH_LIMIT, which are set via environment variables or config files and only take effect after restarting the application. There is no built-in UI or API for runtime adjustment in the Community Edition. For workflow nodes like IterationNode, you can enable parallelism by setting is_parallel to true, but this is a design-time setting, not a runtime control. For true runtime adjustment, code changes would be needed to support dynamic config reloads or a custom API endpoint. More details and parameter references can be found here.

To reply, just mention @dosu.


How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Chat with Dosu Join Discord Share on X

@dosubot[bot] commented on GitHub (Aug 12, 2025): <!-- Answer --> It's not currently possible to adjust the concurrency level for batch processing dynamically while Dify is running. The concurrency is controlled by parameters like SERVER_WORKER_AMOUNT, SERVER_WORKER_CONNECTIONS, APP_MAX_ACTIVE_REQUESTS, thread pool size, and WORKFLOW_PARALLEL_DEPTH_LIMIT, which are set via environment variables or config files and only take effect after restarting the application. There is no built-in UI or API for runtime adjustment in the Community Edition. For workflow nodes like IterationNode, you can enable parallelism by setting is_parallel to true, but this is a design-time setting, not a runtime control. For true runtime adjustment, code changes would be needed to support dynamic config reloads or a custom API endpoint. More details and parameter references can be found [here](https://github.com/langgenius/dify/discussions/20848#discussioncomment-13415933). <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/a04e0ea6-4f2e-4147-b12a-9b4172bb4cc7?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/a04e0ea6-4f2e-4147-b12a-9b4172bb4cc7?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/a04e0ea6-4f2e-4147-b12a-9b4172bb4cc7?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/a04e0ea6-4f2e-4147-b12a-9b4172bb4cc7?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/a04e0ea6-4f2e-4147-b12a-9b4172bb4cc7?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/a04e0ea6-4f2e-4147-b12a-9b4172bb4cc7?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/a04e0ea6-4f2e-4147-b12a-9b4172bb4cc7?feedback_type=other)</sup>&nbsp;&nbsp;[![Chat with Dosu](https://dosu.dev/dosu-chat-badge.svg)](https://app.dosu.dev/6088a4f4-073a-43f3-b3d4-4f06fb0c05a0/ask?utm_source=github)&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify/issues/23852)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#16111