[PR #10966] feat: support LLM process document file #27008

Closed
opened 2026-02-21 20:40:41 -05:00 by yindo · 0 comments
Owner

Original Pull Request: https://github.com/langgenius/dify/pull/10966

State: closed
Merged: Yes


Summary

Tip

Close issue syntax: Fixes #<issue number> or Resolves #<issue number>, see documentation for more details.

Currently, lots of LLM( gemini, sonnet ...) can directly process document, and make user's chat context based on these documents. This PR aimed to support this feature in a dify agent app. For the chatflow app, maybe this PR can resolve.

ChangeList

Backend

  • add DocumentPromptMessageContent and more model features, copied from https://github.com/langgenius/dify/pull/10679
  • support gemini series models receive document
  • add video feature to support video models, document feature to support document models

Frontend

  • add a switch button to control whether allow upload document
  • for not support video feature's LLM, open vision config will not allow upload video
  • chat page whether display file upload button depends on file.allowed_file_types has any value

remaining issues

  • the vision settings is strange, Resolution only affect Image type files, Upload Method and Upload Limit affect all type files.

Screenshots

image

Checklist

Important

Please review the checklist below before submitting your pull request.

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
**Original Pull Request:** https://github.com/langgenius/dify/pull/10966 **State:** closed **Merged:** Yes --- # Summary > [!Tip] > Close issue syntax: `Fixes #<issue number>` or `Resolves #<issue number>`, see [documentation](https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword) for more details. Currently, lots of LLM( gemini, sonnet ...) can directly process document, and make user's chat context based on these documents. This PR aimed to support this feature in a dify agent app. For the chatflow app, maybe this [PR](https://github.com/langgenius/dify/pull/10679) can resolve. ## ChangeList #### Backend - add `DocumentPromptMessageContent` and more model features, copied from https://github.com/langgenius/dify/pull/10679 - support gemini series models receive document - add `video` feature to support video models, `document` feature to support document models #### Frontend - add a switch button to control whether allow upload document - for not support video feature's LLM, open vision config will not allow upload video - chat page whether display file upload button depends on `file.allowed_file_types` has any value #### remaining issues - the vision settings is strange, `Resolution` only affect Image type files, `Upload Method` and `Upload Limit` affect all type files. # Screenshots ![image](https://github.com/user-attachments/assets/a592b545-cffe-49a8-a854-6496e96c98ca) # Checklist > [!IMPORTANT] > Please review the checklist below before submitting your pull request. - [ ] This change requires a documentation update, included: [Dify Document](https://github.com/langgenius/dify-docs) - [x] I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!) - [x] I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change. - [x] I've updated the documentation accordingly. - [x] I ran `dev/reformat`(backend) and `cd web && npx lint-staged`(frontend) to appease the lint gods
yindo added the pull-request label 2026-02-21 20:40:41 -05:00
yindo closed this issue 2026-02-21 20:40:41 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#27008