Add Arize OSS Phoenix integration #7408

Closed
opened 2026-02-21 18:20:27 -05:00 by yindo · 9 comments
Owner

Originally created by @nate-mar on GitHub (Dec 26, 2024).

Originally assigned to: @nate-mar on GitHub.

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

There's a good set of llm observability platforms out there right now. Dify currently integrates with Langfuse and Langsmith. This issue is to propose adding integration with Arize OSS Phoenix to give Dify users another option. Note: I work with the Phoenix team.

This has also been requested by the community in an issue on the Phoenix repo: https://github.com/Arize-ai/phoenix/issues/5299 (also mentioned by the same user in the dify repo: https://github.com/langgenius/dify/issues/10434).

Happy to take this one on myself :)

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @nate-mar on GitHub (Dec 26, 2024). Originally assigned to: @nate-mar on GitHub. ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. There's a good set of llm observability platforms out there right now. Dify currently integrates with Langfuse and Langsmith. This issue is to propose adding integration with [Arize OSS Phoenix](https://phoenix.arize.com) to give Dify users another option. Note: I work with the Phoenix team. This has also been requested by the community in an issue on the Phoenix repo: https://github.com/Arize-ai/phoenix/issues/5299 (also mentioned by the same user in the dify repo: https://github.com/langgenius/dify/issues/10434). Happy to take this one on myself :) ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:20:27 -05:00
yindo closed this issue 2026-02-21 18:20:27 -05:00
Author
Owner

@nate-mar commented on GitHub (Jan 8, 2025):

Just following up this, I'm not sure if there's a specific person I should ping, but I'm happy to start working on this if someone wants to assign it to me. Thanks!

@nate-mar commented on GitHub (Jan 8, 2025): Just following up this, I'm not sure if there's a specific person I should ping, but I'm happy to start working on this if someone wants to assign it to me. Thanks!
Author
Owner

@crazywoola commented on GitHub (Jan 9, 2025):

Hello if you would like to add integration to our repo, I figure you could take a look at this https://github.com/langgenius/dify/pull/11501 as well.

@nate-mar

@crazywoola commented on GitHub (Jan 9, 2025): Hello if you would like to add integration to our repo, I figure you could take a look at this https://github.com/langgenius/dify/pull/11501 as well. @nate-mar
Author
Owner

@dosubot[bot] commented on GitHub (Feb 10, 2025):

Hi, @nate-mar. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You suggested adding an integration with Arize OSS Phoenix to the Dify platform.
  • You expressed willingness to contribute to this development.
  • Crazywoola provided guidance by directing you to a related pull request.

Next Steps:

  • Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Feb 10, 2025): Hi, @nate-mar. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - You suggested adding an integration with Arize OSS Phoenix to the Dify platform. - You expressed willingness to contribute to this development. - Crazywoola provided guidance by directing you to a related pull request. **Next Steps:** - Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here. - If there is no further activity, this issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Author
Owner

@nate-mar commented on GitHub (Feb 11, 2025):

I'll be working on this starting next week

@nate-mar commented on GitHub (Feb 11, 2025): I'll be working on this starting next week
Author
Owner

@dosubot[bot] commented on GitHub (Feb 11, 2025):

@takatost, the user @nate-mar has indicated they will be working on the integration with Arize OSS Phoenix starting next week. Could you please assist them with this issue?

@dosubot[bot] commented on GitHub (Feb 11, 2025): @takatost, the user @nate-mar has indicated they will be working on the integration with Arize OSS Phoenix starting next week. Could you please assist them with this issue?
Author
Owner

@crazywoola commented on GitHub (Mar 4, 2025):

@nate-mar Hey please use this doc https://docs.dify.ai/plugins/introduction to start building :)

@crazywoola commented on GitHub (Mar 4, 2025): @nate-mar Hey please use this doc https://docs.dify.ai/plugins/introduction to start building :)
Author
Owner

@nate-mar commented on GitHub (Mar 4, 2025):

Gotcha! Thanks for the pointer @crazywoola -- I'll take a look at that, but just for my own reference, is this going to be different than the approach taken for the existing observability platforms? I'm currently in progress on implementing Phoenix in a similar way.

Thanks!

@nate-mar commented on GitHub (Mar 4, 2025): Gotcha! Thanks for the pointer @crazywoola -- I'll take a look at that, but just for my own reference, is this going to be different than the approach taken for the existing observability platforms? I'm currently in progress on implementing Phoenix in a similar way. Thanks!
Author
Owner

@guchenhe commented on GitHub (Mar 27, 2025):

hey @nate-mar , I think Arize should be integrated in a similar way to other platforms. https://github.com/langgenius/dify/pull/11501 should indeed be the reference point.

@guchenhe commented on GitHub (Mar 27, 2025): hey @nate-mar , I think Arize should be integrated in a similar way to other platforms. https://github.com/langgenius/dify/pull/11501 should indeed be the reference point.
Author
Owner

@dosubot[bot] commented on GitHub (Apr 27, 2025):

Hi, @nate-mar. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You proposed integrating Arize OSS Phoenix with Dify for LLM observability.
  • Currently, Dify supports Langfuse and Langsmith for observability.
  • Crazywoola and guchenhe suggested referring to a related pull request and documentation for plugin development.
  • You confirmed your commitment to start working on the integration and are seeking clarification on the approach.

Next Steps:

  • Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If no updates are provided, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Apr 27, 2025): Hi, @nate-mar. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary:** - You proposed integrating Arize OSS Phoenix with Dify for LLM observability. - Currently, Dify supports Langfuse and Langsmith for observability. - Crazywoola and guchenhe suggested referring to a related pull request and documentation for plugin development. - You confirmed your commitment to start working on the integration and are seeking clarification on the approach. **Next Steps:** - Please let me know if this issue is still relevant to the latest version of the Dify repository by commenting here. - If no updates are provided, the issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#7408