[PR #1192] [MERGED] feat: support OpenRouter reasoning tokens excluding, repair OpenRouter tool use #1761

Closed
opened 2026-02-16 10:23:53 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-official-plugins/pull/1192
Author: @orangeclk
Created: 7/2/2025
Status: Merged
Merged: 7/3/2025
Merged by: @crazywoola

Base: mainHead: openrouter-reason-exclude


📝 Commits (2)

  • bad0e0c feat: support openrouter reasoning tokens excluding
  • 11b1fff fix: openrouter tool use repair

📊 Changes

11 files changed (+106 additions, -39 deletions)

View changed files

📝 models/openrouter/manifest.yaml (+1 -1)
📝 models/openrouter/models/llm/claude-3.7-sonnet-thinking.yaml (+0 -0)
📝 models/openrouter/models/llm/claude-3.7-sonnet.yaml (+10 -0)
📝 models/openrouter/models/llm/claude-sonnet-4.yaml (+10 -0)
📝 models/openrouter/models/llm/gemini-2.5-flash-lite-preview-06-17.yaml (+11 -2)
📝 models/openrouter/models/llm/gemini-2.5-flash.yaml (+11 -2)
📝 models/openrouter/models/llm/gemini-2.5-pro.yaml (+13 -3)
📝 models/openrouter/models/llm/grok-3-mini-beta.yaml (+10 -0)
📝 models/openrouter/models/llm/llm.py (+22 -31)
📝 models/openrouter/provider/openrouter.yaml (+18 -0)
openrouter.difypkg (+0 -0)

📄 Description

Related Issues or Context

image
Support has been added for OpenRouter's feature to exclude Chain-of-Thought (CoT) reasoning from the response. This enables CoT models to directly support Dify's structured output, eliminating the need for users to add separate nodes for CoT cleanup or parameter extraction.
Furthermore, the code handling OpenRouter's reasoning parameter has been streamlined for better robustness and simplicity, also leading to a more intuitive user interface.
It takes effect for the Gemini 2.5, Claude Sonnet and Grok 3 series.
image

Fixes #1088 and fix #21847
image
The function call issues for both predefined and customized models have been fixed.

Fixes this: https://github.com/langgenius/dify-official-plugins/pull/1177#issuecomment-3026507341

This PR contains Changes to Non-Plugin

  • Documentation
  • Other

This PR contains Changes to Non-LLM Models Plugin

  • I have Run Comprehensive Tests Relevant to My Changes

This PR contains Changes to LLM Models Plugin

  • My Changes Affect Message Flow Handling (System Messages and User→Assistant Turn-Taking)
  • My Changes Affect Tool Interaction Flow (Multi-Round Usage and Output Handling, for both Agent App and Agent Node)
  • My Changes Affect Multimodal Input Handling (Images, PDFs, Audio, Video, etc.)
  • My Changes Affect Multimodal Output Generation (Images, Audio, Video, etc.)
  • My Changes Affect Structured Output Format (JSON, XML, etc.)
  • My Changes Affect Token Consumption Metrics
  • My Changes Affect Other LLM Functionalities (Reasoning Process, Grounding, Prompt Caching, etc.)
  • Other Changes (Add New Models, Fix Model Parameters etc.)

Version Control (Any Changes to the Plugin Will Require Bumping the Version)

  • I have Bumped Up the Version in Manifest.yaml (Top-Level Version Field, Not in Meta Section)

Dify Plugin SDK Version

  • I have Ensured dify_plugin>=0.3.0,<0.5.0 is in requirements.txt (SDK docs)

Environment Verification (If Any Code Changes)

Local Deployment Environment

  • Dify Version is: 1.5.0, I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration.

SaaS Environment

  • I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-official-plugins/pull/1192 **Author:** [@orangeclk](https://github.com/orangeclk) **Created:** 7/2/2025 **Status:** ✅ Merged **Merged:** 7/3/2025 **Merged by:** [@crazywoola](https://github.com/crazywoola) **Base:** `main` ← **Head:** `openrouter-reason-exclude` --- ### 📝 Commits (2) - [`bad0e0c`](https://github.com/langgenius/dify-official-plugins/commit/bad0e0c8460ccf773ea8d5320b5e3b6e502c420e) feat: support openrouter reasoning tokens excluding - [`11b1fff`](https://github.com/langgenius/dify-official-plugins/commit/11b1fff4fb37fcffabe58f8e4bd9b059b004bfdb) fix: openrouter tool use repair ### 📊 Changes **11 files changed** (+106 additions, -39 deletions) <details> <summary>View changed files</summary> 📝 `models/openrouter/manifest.yaml` (+1 -1) 📝 `models/openrouter/models/llm/claude-3.7-sonnet-thinking.yaml` (+0 -0) 📝 `models/openrouter/models/llm/claude-3.7-sonnet.yaml` (+10 -0) 📝 `models/openrouter/models/llm/claude-sonnet-4.yaml` (+10 -0) 📝 `models/openrouter/models/llm/gemini-2.5-flash-lite-preview-06-17.yaml` (+11 -2) 📝 `models/openrouter/models/llm/gemini-2.5-flash.yaml` (+11 -2) 📝 `models/openrouter/models/llm/gemini-2.5-pro.yaml` (+13 -3) 📝 `models/openrouter/models/llm/grok-3-mini-beta.yaml` (+10 -0) 📝 `models/openrouter/models/llm/llm.py` (+22 -31) 📝 `models/openrouter/provider/openrouter.yaml` (+18 -0) ➕ `openrouter.difypkg` (+0 -0) </details> ### 📄 Description ## Related Issues or Context <!-- ⚠️ NOTE: This repository is for Dify Official Plugins only. For community contributions, please submit to https://github.com/langgenius/dify-plugins instead. - Link Related Issues if Applicable: #issue_number - Or Provide Context about Why this Change is Needed --> ![image](https://github.com/user-attachments/assets/81293d68-b4b7-429f-b4c1-e7d19b3353fd) Support has been added for OpenRouter's feature to exclude Chain-of-Thought (CoT) reasoning from the response. This enables CoT models to directly support Dify's structured output, eliminating the need for users to add separate nodes for CoT cleanup or parameter extraction. Furthermore, the code handling OpenRouter's reasoning parameter has been streamlined for better robustness and simplicity, also leading to a more intuitive user interface. It takes effect for the Gemini 2.5, Claude Sonnet and Grok 3 series. ![image](https://github.com/user-attachments/assets/2f9776a4-5620-4dba-8c87-72842f772239) Fixes #1088 and fix #21847 ![image](https://github.com/user-attachments/assets/08dc74ce-ca65-4fd7-8bd6-6c057aeb2826) The function call issues for both predefined and customized models have been fixed. Fixes this: https://github.com/langgenius/dify-official-plugins/pull/1177#issuecomment-3026507341 ## This PR contains Changes to *Non-Plugin* <!-- Put an `x` in all the boxes that apply by replacing [ ] with [x] For example: - [x] Documentation --> - [ ] Documentation - [ ] Other ## This PR contains Changes to *Non-LLM Models Plugin* - [ ] I have Run Comprehensive Tests Relevant to My Changes <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> ## This PR contains Changes to *LLM Models Plugin* <!-- LLM Models Test Example: --> <!-- https://github.com/langgenius/dify-official-plugins/blob/main/.assets/test-examples/llm-plugin-tests/llm_test_example.md --> - [ ] My Changes Affect Message Flow Handling (System Messages and User→Assistant Turn-Taking) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [x] My Changes Affect Tool Interaction Flow (Multi-Round Usage and Output Handling, for both Agent App and Agent Node) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Multimodal Input Handling (Images, PDFs, Audio, Video, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Multimodal Output Generation (Images, Audio, Video, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Structured Output Format (JSON, XML, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [ ] My Changes Affect Token Consumption Metrics <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [x] My Changes Affect Other LLM Functionalities (Reasoning Process, Grounding, Prompt Caching, etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> - [x] Other Changes (Add New Models, Fix Model Parameters etc.) <!-- 📷 Include Screenshots/Videos Demonstrating the Fix, New Feature, or the Behavior Before/After Breaking Changes. --> ## Version Control (Any Changes to the Plugin Will Require Bumping the Version) - [x] I have Bumped Up the Version in Manifest.yaml (Top-Level `Version` Field, Not in Meta Section) <!-- ⚠️ NOTE: Version Format: MAJOR.MINOR.PATCH - MAJOR (0.x.x): Reserved for Significant architectural changes or incompatible API modifications - MINOR (x.0.x): For New feature additions while maintaining backward compatibility - PATCH (x.x.0): For Backward-compatible bug fixes and minor improvements - Note: Each Version Component (MAJOR, MINOR, PATCH) Can Be 2 Digits, e.g., 10.11.22 --> ## Dify Plugin SDK Version - [x] I have Ensured `dify_plugin>=0.3.0,<0.5.0` is in requirements.txt ([SDK docs](https://github.com/langgenius/dify-plugin-sdks/blob/main/python/README.md)) ## Environment Verification (If Any Code Changes) <!-- ⚠️ NOTE: At Least One Environment Must Be Tested. --> ### Local Deployment Environment - [x] Dify Version is: 1.5.0<!-- Specify Your Version (e.g., 1.2.0) -->, I have Tested My Changes on Local Deployment Dify with a Clean Environment That Matches the Production Configuration. <!-- - Python Virtual Env Matching Manifest.yaml & requirements.txt - No Breaking Changes in Dify That May Affect the Testing Result --> ### SaaS Environment - [ ] I have Tested My Changes on cloud.dify.ai with a Clean Environment That Matches the Production Configuration <!-- - Python Virtual Env Matching Manifest.yaml & requirements.txt --> --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 10:23:53 -05:00
yindo closed this issue 2026-02-16 10:23:53 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-official-plugins#1761