[PR #668] [MERGED] Feat: Q&A format segmentation support #22621

Closed
opened 2026-02-21 20:19:22 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify/pull/668
Author: @JzoNgKVO
Created: 7/28/2023
Status: Merged
Merged: 7/28/2023
Merged by: @JohnJyong

Base: mainHead: feat/milvus-support


📝 Commits (10+)

  • 90b22d8 add qa model
  • 4c59627 fix clean dataset task
  • 5269b00 Merge branch 'main' into feat/milvus-support
  • 4a45e94 fix clean dataset task
  • 6040da7 Merge branch 'main' into feat/milvus-support
  • 37ad526 add document form and answer field
  • 018511b Merge branch 'main' into feat/milvus-support
  • 2b150ff add update segment and support qa segment
  • 1507b0b add update segment and support qa segment
  • efdc567 Merge branch 'main' into feat/milvus-support

📊 Changes

52 files changed (+2039 additions, -275 deletions)

View changed files

📝 api/controllers/console/datasets/datasets.py (+3 -2)
📝 api/controllers/console/datasets/datasets_document.py (+10 -2)
📝 api/controllers/console/datasets/datasets_segments.py (+90 -3)
📝 api/controllers/console/datasets/hit_testing.py (+1 -0)
📝 api/core/data_loader/loader/excel.py (+1 -1)
📝 api/core/docstore/dataset_docstore.py (+6 -1)
📝 api/core/generator/llm_generator.py (+29 -4)
📝 api/core/index/keyword_table_index/keyword_table_index.py (+10 -0)
api/core/index/vector_index/test-embedding.py (+123 -0)
📝 api/core/indexing_runner.py (+154 -11)
📝 api/core/prompt/prompts.py (+10 -0)
api/core/tool/dataset_index_tool.py (+102 -0)
📝 api/core/tool/dataset_retriever_tool.py (+18 -3)
api/migrations/versions/8d2d099ceb74_add_qa_model_support.py (+42 -0)
📝 api/models/dataset.py (+7 -1)
📝 api/services/completion_service.py (+1 -0)
📝 api/services/dataset_service.py (+98 -5)
api/tasks/create_segment_to_index_task.py (+102 -0)
📝 api/tasks/enable_segment_to_index_task.py (+6 -6)
api/tasks/generate_test_task.py (+24 -0)

...and 32 more files

📄 Description

No description provided


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify/pull/668 **Author:** [@JzoNgKVO](https://github.com/JzoNgKVO) **Created:** 7/28/2023 **Status:** ✅ Merged **Merged:** 7/28/2023 **Merged by:** [@JohnJyong](https://github.com/JohnJyong) **Base:** `main` ← **Head:** `feat/milvus-support` --- ### 📝 Commits (10+) - [`90b22d8`](https://github.com/langgenius/dify/commit/90b22d8c3745b682e46c522e844e5add0f63f9fc) add qa model - [`4c59627`](https://github.com/langgenius/dify/commit/4c596272fd72381e961ad5be13b31826ae5ef272) fix clean dataset task - [`5269b00`](https://github.com/langgenius/dify/commit/5269b00d8fddd07739bb24efe338e491f6ebf6a8) Merge branch 'main' into feat/milvus-support - [`4a45e94`](https://github.com/langgenius/dify/commit/4a45e94b49835e2a54e0c5037c680a8b8089899e) fix clean dataset task - [`6040da7`](https://github.com/langgenius/dify/commit/6040da754b6b40d9bc939adc26272ebde24ae1d7) Merge branch 'main' into feat/milvus-support - [`37ad526`](https://github.com/langgenius/dify/commit/37ad526a032f87efc94eed4eb9aeb06906b2b5a1) add document form and answer field - [`018511b`](https://github.com/langgenius/dify/commit/018511b8997a5f47f38b96ea738ad7c575e00bcd) Merge branch 'main' into feat/milvus-support - [`2b150ff`](https://github.com/langgenius/dify/commit/2b150ffde985cccbab6784ff76d05355ef05e40a) add update segment and support qa segment - [`1507b0b`](https://github.com/langgenius/dify/commit/1507b0b124f58600b10c7e634f2adca122153d72) add update segment and support qa segment - [`efdc567`](https://github.com/langgenius/dify/commit/efdc567efe8d775f6efceeeaed6135b3af7efddf) Merge branch 'main' into feat/milvus-support ### 📊 Changes **52 files changed** (+2039 additions, -275 deletions) <details> <summary>View changed files</summary> 📝 `api/controllers/console/datasets/datasets.py` (+3 -2) 📝 `api/controllers/console/datasets/datasets_document.py` (+10 -2) 📝 `api/controllers/console/datasets/datasets_segments.py` (+90 -3) 📝 `api/controllers/console/datasets/hit_testing.py` (+1 -0) 📝 `api/core/data_loader/loader/excel.py` (+1 -1) 📝 `api/core/docstore/dataset_docstore.py` (+6 -1) 📝 `api/core/generator/llm_generator.py` (+29 -4) 📝 `api/core/index/keyword_table_index/keyword_table_index.py` (+10 -0) ➕ `api/core/index/vector_index/test-embedding.py` (+123 -0) 📝 `api/core/indexing_runner.py` (+154 -11) 📝 `api/core/prompt/prompts.py` (+10 -0) ➕ `api/core/tool/dataset_index_tool.py` (+102 -0) 📝 `api/core/tool/dataset_retriever_tool.py` (+18 -3) ➕ `api/migrations/versions/8d2d099ceb74_add_qa_model_support.py` (+42 -0) 📝 `api/models/dataset.py` (+7 -1) 📝 `api/services/completion_service.py` (+1 -0) 📝 `api/services/dataset_service.py` (+98 -5) ➕ `api/tasks/create_segment_to_index_task.py` (+102 -0) 📝 `api/tasks/enable_segment_to_index_task.py` (+6 -6) ➕ `api/tasks/generate_test_task.py` (+24 -0) _...and 32 more files_ </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-21 20:19:22 -05:00
yindo closed this issue 2026-02-21 20:19:22 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#22621