[PR #3398] feat: support regex pattern in segement #24108

Closed
opened 2026-02-21 20:22:23 -05:00 by yindo · 0 comments
Owner

Original Pull Request: https://github.com/langgenius/dify/pull/3398

State: closed
Merged: No


Description

Use regex pattern to better control the segement result in text cleaning

Type of Change

Please delete options that are not relevant.

  • New feature (non-breaking change which adds functionality)

How Has This Been Tested?

  • Tested in local environment

Suggested Checklist:

  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings

Next Step:

  • Please help edit i18n transelate for 'separatorPlaceholder' in all dataset-creation.ts files, because I'm afraid my translation won't be accurate
  • Update frontpage to separate two way of split chunks,make it easier to use
**Original Pull Request:** https://github.com/langgenius/dify/pull/3398 **State:** closed **Merged:** No --- # Description Use regex pattern to better control the segement result in text cleaning ## Type of Change Please delete options that are not relevant. - [x] New feature (non-breaking change which adds functionality) # How Has This Been Tested? - [x] Tested in local environment # Suggested Checklist: - [x] I have performed a self-review of my own code - [x] I have commented my code, particularly in hard-to-understand areas - [x] My changes generate no new warnings # Next Step: - [x] Please help edit i18n transelate for 'separatorPlaceholder' in all dataset-creation.ts files, because I'm afraid my translation won't be accurate - [ ] Update frontpage to separate two way of split chunks,make it easier to use
yindo added the pull-request label 2026-02-21 20:22:23 -05:00
yindo closed this issue 2026-02-21 20:22:23 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#24108