[PR #13866] fix: token calculation method of Moonshot and Stepfun #28066

Closed
opened 2026-02-21 20:42:44 -05:00 by yindo · 0 comments
Owner

Original Pull Request: https://github.com/langgenius/dify/pull/13866

State: closed
Merged: No


Summary

Caused by this PR #13518. It only fix the case where tools is not a list when inputting token calculation.

But the root cause lies in the parameter change of _num_tokens_from_string. #13299
The above fix will cause tokens calculation to use model as calculation, resulting in miscalculation.

Screenshots

Before After
... ...

Checklist

Important

Please review the checklist below before submitting your pull request.

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
**Original Pull Request:** https://github.com/langgenius/dify/pull/13866 **State:** closed **Merged:** No --- # Summary Caused by this PR #13518. It only fix the case where tools is not a list when inputting token calculation. But the root cause lies in the parameter change of _num_tokens_from_string. #13299 The above fix will cause tokens calculation to use model as calculation, resulting in miscalculation. # Screenshots | Before | After | |--------|-------| | ... | ... | # Checklist > [!IMPORTANT] > Please review the checklist below before submitting your pull request. - [ ] This change requires a documentation update, included: [Dify Document](https://github.com/langgenius/dify-docs) - [x] I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!) - [x] I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change. - [x] I've updated the documentation accordingly. - [x] I ran `dev/reformat`(backend) and `cd web && npx lint-staged`(frontend) to appease the lint gods
yindo added the pull-request label 2026-02-21 20:42:44 -05:00
yindo closed this issue 2026-02-21 20:42:44 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#28066