langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-21 20:15:31 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

Add user feedback in langfuse message trace #6624

New Issue
Closed
opened 2026-02-21 18:16:36 -05:00 by yindo · 4 comments
yindo commented 2026-02-21 18:16:36 -05:00
Owner
Copy Link
Copy Source

Originally created by @wy96f on GitHub (Nov 7, 2024).

Originally assigned to: @ZhouhaoJiang on GitHub.

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

The operations team wants to view messages about users liking or disliking, incorporate them into the dataset for annotation, and optimize the overall application's response effectiveness.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @wy96f on GitHub (Nov 7, 2024). Originally assigned to: @ZhouhaoJiang on GitHub. ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:） - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. The operations team wants to view messages about users liking or disliking, incorporate them into the dataset for annotation, and optimize the overall application's response effectiveness. ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [ ] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:16:36 -05:00
yindo closed this issue 2026-02-21 18:16:36 -05:00
yindo commented 2026-02-21 18:16:36 -05:00
Author
Owner
Copy Link
Copy Source

@ZhouhaoJiang commented on GitHub (Nov 8, 2024):

@wy96f Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time.

@ZhouhaoJiang commented on GitHub (Nov 8, 2024): @wy96f Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time.
yindo commented 2026-02-21 18:16:36 -05:00
Author
Owner
Copy Link
Copy Source

@wy96f commented on GitHub (Nov 8, 2024):

@wy96f Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time.

@ZhouhaoJiang Got it, thanks for reply. Do you have plans to support phoenix(https://github.com/Arize-ai/phoenix)? It is also a popular open-source project that many people are using.

@wy96f commented on GitHub (Nov 8, 2024): > @wy96f Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time. @ZhouhaoJiang Got it, thanks for reply. Do you have plans to support phoenix(https://github.com/Arize-ai/phoenix)? It is also a popular open-source project that many people are using.
yindo commented 2026-02-21 18:16:36 -05:00
Author
Owner
Copy Link
Copy Source

@dosubot[bot] commented on GitHub (Dec 9, 2024):

Hi, @wy96f. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary

  • You requested user feedback features (likes/dislikes) for langfuse message trace.
  • @ZhouhaoJiang mentioned the focus is on model usage and performance metrics.
  • You acknowledged and asked about support for the Phoenix project.

Next Steps

  • Is this issue still relevant to the latest version of Dify? If so, please comment to keep the discussion open.
  • If there are no updates, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Dec 9, 2024): Hi, @wy96f. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary** - You requested user feedback features (likes/dislikes) for langfuse message trace. - @ZhouhaoJiang mentioned the focus is on model usage and performance metrics. - You acknowledged and asked about support for the Phoenix project. **Next Steps** - Is this issue still relevant to the latest version of Dify? If so, please comment to keep the discussion open. - If there are no updates, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
yindo commented 2026-02-21 18:16:36 -05:00
Author
Owner
Copy Link
Copy Source

@gosailing commented on GitHub (Feb 8, 2025):

@wy96f Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time.

Hi Haojing, we have the same question about dify sync data with ops tool like langfuse, understand your goal is to track model usage, while from using dify to develop llm apps, devs may need export 'liked' qa pairs as dify knowledge entry. Do you think it make sense to add 'user rate(like or dislike)' field to message trace info in syncing with ops tools? Thanks

@gosailing commented on GitHub (Feb 8, 2025): > [@wy96f](https://github.com/wy96f) Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time. Hi Haojing, we have the same question about dify sync data with ops tool like langfuse, understand your goal is to track model usage, while from using dify to develop llm apps, devs may need export 'liked' qa pairs as dify knowledge entry. Do you think it make sense to add 'user rate(like or dislike)' field to message trace info in syncing with ops tools? Thanks
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label 💪 enhancement
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#6624
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?