[PR #219] [MERGED] benchmark/local-runtime #379

Closed
opened 2026-02-16 01:15:47 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langgenius/dify-plugin-daemon/pull/219
Author: @Yeuoly
Created: 4/16/2025
Status: Merged
Merged: 4/16/2025
Merged by: @Yeuoly

Base: mainHead: benchmark/local-runtime


📝 Commits (7)

📊 Changes

9 files changed (+481 additions, -40 deletions)

View changed files

📝 .github/workflows/benchmark.yml (+13 -1)
internal/core/plugin_daemon/basic.go (+0 -15)
📝 internal/core/plugin_daemon/generic.go (+2 -16)
internal/core/plugin_daemon/generic_invoke/mapping.go (+34 -0)
internal/core/plugin_manager/.gitignore (+1 -0)
internal/core/plugin_manager/local_runtime_benchmark_fake_openai.go (+151 -0)
internal/core/plugin_manager/local_runtime_benchmark_test.go (+263 -0)
📝 internal/core/plugin_manager/runtime_lifetime.go (+17 -8)
internal/core/plugin_manager/testdata/openai.difypkg (+0 -0)

📄 Description

Benchmark

Add benchmark (load tests) for local-runtime

Test condition

  • OpenAI plugin 0.19
  • 100 concurrency requests to local runtime
  • only LLM invoke (with 4s invocation time)
  • 30s

benchmark test tool will continually increase the b.N to reach the 30s limit, and the final result is the number of executions when its total execution time reaches 30s


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langgenius/dify-plugin-daemon/pull/219 **Author:** [@Yeuoly](https://github.com/Yeuoly) **Created:** 4/16/2025 **Status:** ✅ Merged **Merged:** 4/16/2025 **Merged by:** [@Yeuoly](https://github.com/Yeuoly) **Base:** `main` ← **Head:** `benchmark/local-runtime` --- ### 📝 Commits (7) - [`465bb73`](https://github.com/langgenius/dify-plugin-daemon/commit/465bb73ae75c054e204f91f0f0442ee20b6d8397) benchmark/local-runtime - [`b38900c`](https://github.com/langgenius/dify-plugin-daemon/commit/b38900c26e0795f0e81488794a9112a2479f9ef7) test - [`db51fa4`](https://github.com/langgenius/dify-plugin-daemon/commit/db51fa47c724379f54a041abd428415c7a4fa083) fix - [`81f08bc`](https://github.com/langgenius/dify-plugin-daemon/commit/81f08bc86a052dcc30ef3c2c70840d206357fd29) fix: add uv - [`072cb88`](https://github.com/langgenius/dify-plugin-daemon/commit/072cb887df9631387c2a9cd0929125e2b983f2a3) fix: uv path - [`c8eaa13`](https://github.com/langgenius/dify-plugin-daemon/commit/c8eaa13be746ed5a3f6a221f588e5617160a1f4f) fix: get uv - [`ae14208`](https://github.com/langgenius/dify-plugin-daemon/commit/ae14208bd0a31aad4a2c400ada6c2c5ca77157e5) done ### 📊 Changes **9 files changed** (+481 additions, -40 deletions) <details> <summary>View changed files</summary> 📝 `.github/workflows/benchmark.yml` (+13 -1) ➖ `internal/core/plugin_daemon/basic.go` (+0 -15) 📝 `internal/core/plugin_daemon/generic.go` (+2 -16) ➕ `internal/core/plugin_daemon/generic_invoke/mapping.go` (+34 -0) ➕ `internal/core/plugin_manager/.gitignore` (+1 -0) ➕ `internal/core/plugin_manager/local_runtime_benchmark_fake_openai.go` (+151 -0) ➕ `internal/core/plugin_manager/local_runtime_benchmark_test.go` (+263 -0) 📝 `internal/core/plugin_manager/runtime_lifetime.go` (+17 -8) ➕ `internal/core/plugin_manager/testdata/openai.difypkg` (+0 -0) </details> ### 📄 Description ## Benchmark Add benchmark (load tests) for local-runtime ### Test condition - OpenAI plugin 0.19 - 100 concurrency requests to local runtime - only LLM invoke (with 4s invocation time) - 30s benchmark test tool will continually increase the `b.N` to reach the 30s limit, and the final result is the number of executions when its total execution time reaches 30s --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 01:15:47 -05:00
yindo closed this issue 2026-02-16 01:15:47 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify-plugin-daemon#379