langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-22 04:25:29 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Upload file to analyse from chat window #744

New Issue
Closed
opened 2026-02-21 17:28:15 -05:00 by yindo · 6 comments
yindo commented 2026-02-21 17:28:15 -05:00
Owner
Copy Link
Copy Source

Originally created by @yagobski on GitHub (Nov 27, 2023).

Description of the new feature / enhancement

Add the capability to upload a file via the chat or API. This differs from the dataset feature, which is intended for adding to the chatbot's knowledge base. Instead, I propose a functionality that allows users to send a file along with their message, which can then be analyzed by the chatbot, similar to the service provided by OpenAI.

Scenario when this would be used?

This feature would be particularly useful in scenarios where users need to share documents or files for real-time analysis or feedback from the chatbot. For instance:

Customer Support: A customer could upload an image of a damaged product or a screenshot of an error message they are encountering. The chatbot could then analyze the image and provide immediate troubleshooting advice or escalate the issue to a human agent with the relevant information already provided.

Educational Purposes: Students could upload their essays or assignments. The chatbot could then perform a preliminary review, offering suggestions for improvement, checking for plagiarism, or even grading the assignment based on preset criteria.

Healthcare Consultations: Patients could securely upload medical reports or images of their symptoms. The chatbot, equipped with medical knowledge, could provide preliminary assessments or advice, and prepare the data for review by a medical professional.

Technical Support and Programming: Users could upload code snippets or log files when facing programming issues. The chatbot could analyze these files to identify errors or suggest optimizations.

Language Translation: Users could upload documents in a foreign language, and the chatbot could provide a real-time translation or summary of the content.

Business Analytics: Business professionals could upload data sets for quick analysis. The chatbot could generate insights, reports, or visualizations based on the data provided.

Legal Document Review: Users could upload legal documents, and the chatbot could highlight important clauses, potential issues, or provide a summary of the document's contents.

Supporting information

The proposed feature for uploading files via chat or API for analysis by a chatbot is supported by several key advantages and considerations:

Enhanced User Experience: Allowing users to upload files directly for analysis can significantly improve the user experience. It makes the interaction with the chatbot more dynamic and responsive to the user's specific needs.

Efficiency in Problem-Solving: In cases like customer support or technical troubleshooting, being able to analyze a file (like an error log or an image of a defective product) can lead to faster and more accurate problem resolution.

Educational Applications: For educational purposes, such a feature can assist in personalized learning. Chatbots can provide immediate feedback on assignments or essays, which is beneficial in e-learning environments.

Healthcare Accessibility: In healthcare, this feature could allow for preliminary assessments, making healthcare advice more accessible, especially in remote or underserved areas.

Business and Data Analysis: In a business context, uploading and analyzing data sets can aid in making data-driven decisions more swiftly.

Legal and Compliance Uses: For legal documents, a chatbot could assist in ensuring compliance and identifying key legal points in contracts or agreements.

Language Processing: The ability to upload documents for translation or summary can be a powerful tool in overcoming language barriers.

Security and Privacy Considerations: Implementing this feature requires careful consideration of security and privacy, especially when handling sensitive data like medical records or personal information.

Technical Feasibility and Resources: The development of this feature must consider the technical challenges and resources required, including the ability to process different file types and integrate with existing systems.

Scalability and Performance: The feature should be scalable to handle a high volume of file uploads without significant impacts on chatbot performance.

In summary, the ability to upload files for analysis by a chatbot opens up a wide range of applications across various sectors, enhancing the functionality and effectiveness of chatbot interactions. However, it also necessitates careful planning and consideration of technical, security, and privacy aspects.

Originally created by @yagobski on GitHub (Nov 27, 2023). ### Description of the new feature / enhancement Add the capability to upload a file via the chat or API. This differs from the dataset feature, which is intended for adding to the chatbot's knowledge base. Instead, I propose a functionality that allows users to send a file along with their message, which can then be analyzed by the chatbot, similar to the service provided by OpenAI. ### Scenario when this would be used? This feature would be particularly useful in scenarios where users need to share documents or files for real-time analysis or feedback from the chatbot. For instance: Customer Support: A customer could upload an image of a damaged product or a screenshot of an error message they are encountering. The chatbot could then analyze the image and provide immediate troubleshooting advice or escalate the issue to a human agent with the relevant information already provided. Educational Purposes: Students could upload their essays or assignments. The chatbot could then perform a preliminary review, offering suggestions for improvement, checking for plagiarism, or even grading the assignment based on preset criteria. Healthcare Consultations: Patients could securely upload medical reports or images of their symptoms. The chatbot, equipped with medical knowledge, could provide preliminary assessments or advice, and prepare the data for review by a medical professional. Technical Support and Programming: Users could upload code snippets or log files when facing programming issues. The chatbot could analyze these files to identify errors or suggest optimizations. Language Translation: Users could upload documents in a foreign language, and the chatbot could provide a real-time translation or summary of the content. Business Analytics: Business professionals could upload data sets for quick analysis. The chatbot could generate insights, reports, or visualizations based on the data provided. Legal Document Review: Users could upload legal documents, and the chatbot could highlight important clauses, potential issues, or provide a summary of the document's contents. ### Supporting information The proposed feature for uploading files via chat or API for analysis by a chatbot is supported by several key advantages and considerations: Enhanced User Experience: Allowing users to upload files directly for analysis can significantly improve the user experience. It makes the interaction with the chatbot more dynamic and responsive to the user's specific needs. Efficiency in Problem-Solving: In cases like customer support or technical troubleshooting, being able to analyze a file (like an error log or an image of a defective product) can lead to faster and more accurate problem resolution. Educational Applications: For educational purposes, such a feature can assist in personalized learning. Chatbots can provide immediate feedback on assignments or essays, which is beneficial in e-learning environments. Healthcare Accessibility: In healthcare, this feature could allow for preliminary assessments, making healthcare advice more accessible, especially in remote or underserved areas. Business and Data Analysis: In a business context, uploading and analyzing data sets can aid in making data-driven decisions more swiftly. Legal and Compliance Uses: For legal documents, a chatbot could assist in ensuring compliance and identifying key legal points in contracts or agreements. Language Processing: The ability to upload documents for translation or summary can be a powerful tool in overcoming language barriers. Security and Privacy Considerations: Implementing this feature requires careful consideration of security and privacy, especially when handling sensitive data like medical records or personal information. Technical Feasibility and Resources: The development of this feature must consider the technical challenges and resources required, including the ability to process different file types and integrate with existing systems. Scalability and Performance: The feature should be scalable to handle a high volume of file uploads without significant impacts on chatbot performance. In summary, the ability to upload files for analysis by a chatbot opens up a wide range of applications across various sectors, enhancing the functionality and effectiveness of chatbot interactions. However, it also necessitates careful planning and consideration of technical, security, and privacy aspects.
yindo added the 💪 enhancement label 2026-02-21 17:28:15 -05:00
yindo closed this issue 2026-02-21 17:28:15 -05:00
yindo commented 2026-02-21 17:28:15 -05:00
Author
Owner
Copy Link
Copy Source

@waltcow commented on GitHub (Nov 27, 2023):

it seems very useful, the process of upload file may slightly different from dataset

@waltcow commented on GitHub (Nov 27, 2023): it seems very useful, the process of upload file may slightly different from dataset
yindo commented 2026-02-21 17:28:15 -05:00
Author
Owner
Copy Link
Copy Source

@crazywoola commented on GitHub (Nov 28, 2023):

I have already talked to PM yesterday. I think this is reasonable.

@crazywoola commented on GitHub (Nov 28, 2023): I have already talked to PM yesterday. I think this is reasonable.
yindo commented 2026-02-21 17:28:15 -05:00
Author
Owner
Copy Link
Copy Source

@yagobski commented on GitHub (Nov 28, 2023):

I see in this screenshot https://framerusercontent.com/images/BI1avL2kTWhRlUKHEBe5FP30bo.png that the feature already exist. The image is displayed on the homepage of dify.io.
I see also in the API reference POST chat-messages that we can attach a file but only images are accepted.
Can we just remove this limitation of image format?

@yagobski commented on GitHub (Nov 28, 2023): I see in this screenshot https://framerusercontent.com/images/BI1avL2kTWhRlUKHEBe5FP30bo.png that the feature already exist. The image is displayed on the homepage of dify.io. I see also in the API reference POST chat-messages that we can attach a file but only images are accepted. Can we just remove this limitation of image format?
yindo commented 2026-02-21 17:28:15 -05:00
Author
Owner
Copy Link
Copy Source

@github-actions[bot] commented on GitHub (Dec 13, 2023):

Close due to it's no longer active, if you have any questions, you can reopen it.

@github-actions[bot] commented on GitHub (Dec 13, 2023): Close due to it's no longer active, if you have any questions, you can reopen it.
yindo commented 2026-02-21 17:28:16 -05:00
Author
Owner
Copy Link
Copy Source

@pascalwhoop commented on GitHub (Mar 7, 2024):

I think @yagobski you have an idea already, is there a world where this can be a quick PR?

@pascalwhoop commented on GitHub (Mar 7, 2024): I think @yagobski you have an idea already, is there a world where this can be a quick PR?
yindo commented 2026-02-21 17:28:16 -05:00
Author
Owner
Copy Link
Copy Source

@yyipkei123 commented on GitHub (Jul 26, 2024):

is it possible to add this feature in the future? It would be really useful for understanding multiple documents at once.

@yyipkei123 commented on GitHub (Jul 26, 2024): is it possible to add this feature in the future? It would be really useful for understanding multiple documents at once.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 💪 enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#744
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?