langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-21 12:05:30 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Adding upstage layout analysis for parsing documents such as html, pdf, jpg... #4885

New Issue
Closed
opened 2026-02-21 18:08:28 -05:00 by yindo · 5 comments
yindo commented 2026-02-21 18:08:28 -05:00
Owner
Copy Link
Copy Source

Originally created by @JuHyung-Son on GitHub (Aug 5, 2024).

Originally assigned to: @crazywoola, @Yawen-1010 on GitHub.

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

It is hard to index unstructured documents like html, pdfs.
If unstructured document parsing api is available, it will very powerful tool for dify.

and upstage Layout analysis is world leading unstructured document parsing api.
you can check its performance here.

https://en.content.upstage.ai/blog/business/introducing-layout-analysis
https://developers.upstage.ai/docs/apis/layout-analysis

Also, this api is going to be opensourced.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @JuHyung-Son on GitHub (Aug 5, 2024). Originally assigned to: @crazywoola, @Yawen-1010 on GitHub. ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. It is hard to index unstructured documents like html, pdfs. If unstructured document parsing api is available, it will very powerful tool for dify. and upstage Layout analysis is world leading unstructured document parsing api. you can check its performance here. https://en.content.upstage.ai/blog/business/introducing-layout-analysis https://developers.upstage.ai/docs/apis/layout-analysis Also, this api is going to be opensourced. ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:08:28 -05:00
yindo closed this issue 2026-02-21 18:08:28 -05:00
yindo commented 2026-02-21 18:08:28 -05:00
Author
Owner
Copy Link
Copy Source

@JuHyung-Son commented on GitHub (Aug 5, 2024):

@crazywoola

I'm not sure how to add this feature, I thought Layout Analysis is an api so it should go in model_runtime, but according to the documentation it only supports models that can do the following tasks.

LLM - LLM text completion, dialogue, pre-computed tokens capability
Text Embedding Model - Text Embedding, pre-computed tokens capability
Rerank Model - Segment Rerank capability
Speech-to-text Model - Speech to text capability
Text-to-speech Model - Text to speech capability
Moderation - Moderation capability

@JuHyung-Son commented on GitHub (Aug 5, 2024): @crazywoola I'm not sure how to add this feature, I thought Layout Analysis is an api so it should go in model_runtime, but according to [the documentation](https://github.com/langgenius/dify/tree/main/api/core/model_runtime#features) it only supports models that can do the following tasks. LLM - LLM text completion, dialogue, pre-computed tokens capability Text Embedding Model - Text Embedding, pre-computed tokens capability Rerank Model - Segment Rerank capability Speech-to-text Model - Speech to text capability Text-to-speech Model - Text to speech capability Moderation - Moderation capability
yindo commented 2026-02-21 18:08:28 -05:00
Author
Owner
Copy Link
Copy Source

@crazywoola commented on GitHub (Sep 6, 2024):

@JuHyung-Son

Hello, sorry for the late response.

I think you are looking for this, right?

https://github.com/langgenius/dify/blob/85fc0fdb51e38c1c9efae0d3556393b098d64853/docker/.env.example#L415-L422

And if you would like to contribute, you can fulfill something like below.

https://github.com/langgenius/dify/blob/e4f686deb71e59b8d36a6c31a5480a676f522a34/api/core/rag/extractor/unstructured/unstructured_xml_extractor.py

@crazywoola commented on GitHub (Sep 6, 2024): @JuHyung-Son Hello, sorry for the late response. I think you are looking for this, right? https://github.com/langgenius/dify/blob/85fc0fdb51e38c1c9efae0d3556393b098d64853/docker/.env.example#L415-L422 And if you would like to contribute, you can fulfill something like below. https://github.com/langgenius/dify/blob/e4f686deb71e59b8d36a6c31a5480a676f522a34/api/core/rag/extractor/unstructured/unstructured_xml_extractor.py
yindo commented 2026-02-21 18:08:28 -05:00
Author
Owner
Copy Link
Copy Source

@seungwoos commented on GitHub (Oct 15, 2024):

@JuHyung-Son

Hi, I just found that Upstage's Document Parse is way better than any other tools.
Is there any plan for or progress in incorporating Document Parse into Dify?

@seungwoos commented on GitHub (Oct 15, 2024): @JuHyung-Son Hi, I just found that Upstage's Document Parse is way better than any other tools. Is there any plan for or progress in incorporating Document Parse into Dify?
yindo commented 2026-02-21 18:08:28 -05:00
Author
Owner
Copy Link
Copy Source

@taowang1993 commented on GitHub (Oct 23, 2024):

opensourced

Where is the open source repo?

I can't find it in their github account:

https://github.com/orgs/UpstageAI/repositories

@taowang1993 commented on GitHub (Oct 23, 2024): > opensourced Where is the open source repo? I can't find it in their github account: https://github.com/orgs/UpstageAI/repositories
yindo commented 2026-02-21 18:08:28 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Nov 23, 2024):

Hi, @JuHyung-Son. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You proposed adding an upstage layout analysis feature to enhance document parsing.
  • Current documentation does not list layout analysis as a supported task.
  • Crazywoola provided guidance and support for your contribution.
  • Seungwoos inquired about incorporating Upstage's Document Parse due to its performance.
  • Taowang1993 asked for the open-source repository location for Upstage's tools, which was not found.

Next Steps:

  • Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Nov 23, 2024): Hi, @JuHyung-Son. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - You proposed adding an upstage layout analysis feature to enhance document parsing. - Current documentation does not list layout analysis as a supported task. - Crazywoola provided guidance and support for your contribution. - Seungwoos inquired about incorporating Upstage's Document Parse due to its performance. - Taowang1993 asked for the open-source repository location for Upstage's tools, which was not found. **Next Steps:** - Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here. - If there is no further activity, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 💪 enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#4885
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?