[PR #392] [MERGED] Feat/dataset notion import #22481

Closed
opened 2026-02-21 20:19:04 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify/pull/392
Author: @JohnJyong
Created: 6/16/2023
Status: Merged
Merged: 6/16/2023
Merged by: @JohnJyong

Base: mainHead: feat/dataset-notion-import


📝 Commits (10+)

  • f7539ce add notion auth binding
  • 6e725e2 add data source binding and notion auth and callback
  • d834dec add data source integrate list api
  • dbd2bab notion index estimate
  • 3a98c63 add notion import indexing estimate interface
  • 201d994 Merge branch 'main' into feat/dataset-notion-import
  • e2ef272 support notion import documents
  • f1f5d45 support mutil files and notion pages
  • 42c4ab7 add data source binding init and check dataset index status
  • 1268f3b add data source binding init and check dataset index status

📊 Changes

96 files changed (+4495 additions, -383 deletions)

View changed files

📝 api/.env.example (+1 -0)
📝 api/app.py (+1 -1)
📝 api/config.py (+3 -0)
📝 api/controllers/console/__init__.py (+2 -2)
api/controllers/console/auth/data_source_oauth.py (+95 -0)
api/controllers/console/datasets/data_source.py (+303 -0)
📝 api/controllers/console/datasets/datasets.py (+74 -13)
📝 api/controllers/console/datasets/datasets_document.py (+192 -13)
📝 api/controllers/service_api/dataset/document.py (+7 -3)
api/core/data_source/notion.py (+367 -0)
📝 api/core/indexing_runner.py (+193 -67)
📝 api/libs/oauth.py (+7 -0)
api/libs/oauth_data_source.py (+256 -0)
api/migrations/versions/e32f6ccb87c6_e08af0a69ccefbb59fa80c778efee300bb780980.py (+46 -0)
📝 api/models/dataset.py (+3 -1)
api/models/source.py (+21 -0)
📝 api/services/dataset_service.py (+255 -62)
api/tasks/clean_notion_document_task.py (+58 -0)
api/tasks/document_indexing_sync_task.py (+109 -0)
📝 api/tasks/document_indexing_task.py (+20 -16)

...and 76 more files

📄 Description

No description provided


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify/pull/392 **Author:** [@JohnJyong](https://github.com/JohnJyong) **Created:** 6/16/2023 **Status:** ✅ Merged **Merged:** 6/16/2023 **Merged by:** [@JohnJyong](https://github.com/JohnJyong) **Base:** `main` ← **Head:** `feat/dataset-notion-import` --- ### 📝 Commits (10+) - [`f7539ce`](https://github.com/langgenius/dify/commit/f7539ce4c563ea3e0c774e6068fca17016db1509) add notion auth binding - [`6e725e2`](https://github.com/langgenius/dify/commit/6e725e2ed46cef6a65d5ac5cd0d17af8a6037dcc) add data source binding and notion auth and callback - [`d834dec`](https://github.com/langgenius/dify/commit/d834decefff5ca8df2d8a774104611fcacaace71) add data source integrate list api - [`dbd2bab`](https://github.com/langgenius/dify/commit/dbd2babb05d627e855765307fea351e5a822f4f0) notion index estimate - [`3a98c63`](https://github.com/langgenius/dify/commit/3a98c636fd7764fcb15ffcda6b0c810e0788ed84) add notion import indexing estimate interface - [`201d994`](https://github.com/langgenius/dify/commit/201d9943bb8abd86e701f7872a2812031ec69c36) Merge branch 'main' into feat/dataset-notion-import - [`e2ef272`](https://github.com/langgenius/dify/commit/e2ef272f48e1f99d51e2c73044103efec8a3cba1) support notion import documents - [`f1f5d45`](https://github.com/langgenius/dify/commit/f1f5d45d2e9a002dc522ae4399bbfb03da5c914e) support mutil files and notion pages - [`42c4ab7`](https://github.com/langgenius/dify/commit/42c4ab7344c7868030d75da681f3417b5f41a4fe) add data source binding init and check dataset index status - [`1268f3b`](https://github.com/langgenius/dify/commit/1268f3bbfeac3da99b15ef33db76583c252436f6) add data source binding init and check dataset index status ### 📊 Changes **96 files changed** (+4495 additions, -383 deletions) <details> <summary>View changed files</summary> 📝 `api/.env.example` (+1 -0) 📝 `api/app.py` (+1 -1) 📝 `api/config.py` (+3 -0) 📝 `api/controllers/console/__init__.py` (+2 -2) ➕ `api/controllers/console/auth/data_source_oauth.py` (+95 -0) ➕ `api/controllers/console/datasets/data_source.py` (+303 -0) 📝 `api/controllers/console/datasets/datasets.py` (+74 -13) 📝 `api/controllers/console/datasets/datasets_document.py` (+192 -13) 📝 `api/controllers/service_api/dataset/document.py` (+7 -3) ➕ `api/core/data_source/notion.py` (+367 -0) 📝 `api/core/indexing_runner.py` (+193 -67) 📝 `api/libs/oauth.py` (+7 -0) ➕ `api/libs/oauth_data_source.py` (+256 -0) ➕ `api/migrations/versions/e32f6ccb87c6_e08af0a69ccefbb59fa80c778efee300bb780980.py` (+46 -0) 📝 `api/models/dataset.py` (+3 -1) ➕ `api/models/source.py` (+21 -0) 📝 `api/services/dataset_service.py` (+255 -62) ➕ `api/tasks/clean_notion_document_task.py` (+58 -0) ➕ `api/tasks/document_indexing_sync_task.py` (+109 -0) 📝 `api/tasks/document_indexing_task.py` (+20 -16) _...and 76 more files_ </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-21 20:19:04 -05:00
yindo closed this issue 2026-02-21 20:19:04 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#22481