langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-22 04:25:29 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

After clicking [Save&Process] in the document [Chunking Settings], the manually added segments will be lost. #15185

New Issue
Closed
opened 2026-02-21 19:20:35 -05:00 by yindo · 2 comments
yindo commented 2026-02-21 19:20:35 -05:00
Owner
Copy Link
Copy Source

Originally created by @sqj8899 on GitHub (Jul 8, 2025).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.5.1

Cloud or Self Hosted

Cloud

Steps to reproduce

  1. Uploading a document and successfully completing embedding
  2. Click [Add Chunk] to add chunk manually.
  3. Click [Chunking Settings], then click [Save&Process]

✔️ Expected Behavior

There are two expectations by anticipation：

  1. The original document's Chunk is reprocessed according to the set rules.
  2. Chunks added manually should not be removed

❌ Actual Behavior

Chunks previously added manually are lost

Originally created by @sqj8899 on GitHub (Jul 8, 2025). ### Self Checks - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.5.1 ### Cloud or Self Hosted Cloud ### Steps to reproduce 1. Uploading a document and successfully completing embedding 2. Click [Add Chunk] to add chunk manually. 3. Click [Chunking Settings], then click [Save&Process] ### ✔️ Expected Behavior There are two expectations by anticipation： 1. The original document's Chunk is reprocessed according to the set rules. 2. Chunks added manually should not be removed ### ❌ Actual Behavior Chunks previously added manually are lost
yindo added the 🐞 bugcloud labels 2026-02-21 19:20:35 -05:00
yindo closed this issue 2026-02-21 19:20:35 -05:00
yindo commented 2026-02-21 19:20:35 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Jul 8, 2025):

Hi @sqj8899! I'm Dosu and I’m helping the dify team.

This is a current limitation in Dify v1.5.1 (Cloud): when you use [Save&Process] in [Chunking Settings], all existing document chunks—including those added manually—are replaced by new auto-generated chunks according to the updated rules. The system does not distinguish between manual and automatic chunks at the main segment level, so manually added segments are lost during re-chunking. There is no built-in logic to preserve or restore them, and no workaround in the UI to keep manual chunks after reprocessing. This behavior is not documented as intended, but it is how the current implementation works (source).

If you need to preserve manual chunks, avoid using [Save&Process] after adding them, or consider re-adding them after re-chunking.

To reply, just mention @dosu.

How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

@dosubot[bot] commented on GitHub (Jul 8, 2025): <!-- Greeting --> Hi @sqj8899! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the dify team. <!-- Answer --> This is a current limitation in Dify v1.5.1 (Cloud): when you use [Save&Process] in [Chunking Settings], all existing document chunks—including those added manually—are replaced by new auto-generated chunks according to the updated rules. The system does not distinguish between manual and automatic chunks at the main segment level, so manually added segments are lost during re-chunking. There is no built-in logic to preserve or restore them, and no workaround in the UI to keep manual chunks after reprocessing. This behavior is not documented as intended, but it is how the current implementation works ([source](https://github.com/langgenius/dify/blob/f925869f61a357b8cefd5a38d10cb003dbbaac9e/api/services/dataset_service.py)). If you need to preserve manual chunks, avoid using [Save&Process] after adding them, or consider re-adding them after re-chunking. <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot).* --- <sup>How did I do? [Good](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=other)</sup>&nbsp;&nbsp;[![Join Discord](https://img.shields.io/badge/join-5865F2?logo=discord&logoColor=white&label=)](https://go.dosu.dev/discord-bot)&nbsp;[![Share on X](https://img.shields.io/badge/X-share-black)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify/issues/22048)
yindo commented 2026-02-21 19:20:35 -05:00
Author
Owner
Copy Link
Copy Source

@sqj8899 commented on GitHub (Jul 8, 2025):

Hi @sqj8899! I'm Dosu and I’m helping the dify team.

This is a current limitation in Dify v1.5.1 (Cloud): when you use [Save&Process] in [Chunking Settings], all existing document chunks—including those added manually—are replaced by new auto-generated chunks according to the updated rules. The system does not distinguish between manual and automatic chunks at the main segment level, so manually added segments are lost during re-chunking. There is no built-in logic to preserve or restore them, and no workaround in the UI to keep manual chunks after reprocessing. This behavior is not documented as intended, but it is how the current implementation works (source).

If you need to preserve manual chunks, avoid using [Save&Process] after adding them, or consider re-adding them after re-chunking.

To reply, just mention @dosu.

How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other  Join Discord Share on X

Will there be plans to fix or improve this issue later?
For instance, if I manually add many chunks, the current implementation means I can no longer switch embedding models or modify the original document's chunking strategy.

@sqj8899 commented on GitHub (Jul 8, 2025): > Hi [@sqj8899](https://github.com/sqj8899)! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the dify team. > > This is a current limitation in Dify v1.5.1 (Cloud): when you use [Save&Process] in [Chunking Settings], all existing document chunks—including those added manually—are replaced by new auto-generated chunks according to the updated rules. The system does not distinguish between manual and automatic chunks at the main segment level, so manually added segments are lost during re-chunking. There is no built-in logic to preserve or restore them, and no workaround in the UI to keep manual chunks after reprocessing. This behavior is not documented as intended, but it is how the current implementation works ([source](https://github.com/langgenius/dify/blob/f925869f61a357b8cefd5a38d10cb003dbbaac9e/api/services/dataset_service.py)). > > If you need to preserve manual chunks, avoid using [Save&Process] after adding them, or consider re-adding them after re-chunking. > > _To reply, just mention [@dosu](https://go.dosu.dev/dosubot)._ > > How did I do? [Good](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=great_response) | [Irrelevant](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=irrelevant_answer) | [Incorrect](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=incorrect_sources) | [Verbose](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=hallucination) | [Report 🐛](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=bug_report) | [Other](https://app.dosu.dev/response-feedback/ea94db56-a958-4d37-9005-82a706c32e8e?feedback_type=other)  [![Join Discord](https://camo.githubusercontent.com/d562c2df5e4567ea41d37f1d91a4da0839d8341037045b103b2da268998de17f/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f6a6f696e2d3538363546323f6c6f676f3d646973636f7264266c6f676f436f6c6f723d7768697465266c6162656c3d)](https://go.dosu.dev/discord-bot) [![Share on X](https://camo.githubusercontent.com/4649f705e2396d6f328dbc8e800a0509c9c17b3b20253b36706c393df124b93d/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f582d73686172652d626c61636b)](https://twitter.com/intent/tweet?text=%40dosu_ai%20helped%20me%20solve%20this%20issue!&url=https%3A//github.com/langgenius/dify/issues/22048) Will there be plans to fix or improve this issue later? For instance, if I manually add many chunks, the current implementation means I can no longer switch embedding models or modify the original document's chunking strategy.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label cloud 🐞 bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#15185
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?