mirror of
https://github.com/langgenius/dify-plugin-daemon.git
synced 2026-07-22 17:56:00 -04:00
deploy/dev
10 Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
 Xin Zhang
|
4f48fdbc3c | Align plugin manifest validation error messages with regex length limits (#547) | ||
|
Yeuoly
|
888ad788bc |
refactor: plugin lifecycle control panel (#499)
* refactor: introduce local plugin control panel and cleanup environment setup process * fix: args * refactor: new local runtime * temp: stash work for refactor on RemotePluginServer * refactor: unify local runtime lifetime and sperate init environment process * chore: add missing files * stash * refactor: local plugin lifetime control * refactor: complete installation process of control panel * refactor: adapt service layer to new controlpanel * refactor: pluginManager.Install * fix: add routine wrap to InstallServerless, avoid blocking main thread * feat: reinstall serverless runtime * chore: add comments to Reinstall and update confusing naming * refactor: unify install plugin service * refactor: add labels to debugging runtime * refactor: add getters to plugin manager * refactor: split install service to decode/install_task/install service * ??? * refactor: adapt controllers * refactor: session write * refactor: session runtime * Refine install task orchestration (#501) * refactor: installing task * refactor cluster management, decouple lifetime management and cluster * fix cli test command * fix: cleanup TODO comments and implement GracefulStop for instance * feat: add logger to control panel * fix: multiple nil references * refactor: better lifetime control * refactor: better cycle interval * fix(LocalPluginRuntime): prevent returning err when it's not error * fix: avoid adding empty PipExtraArgs * fix: missing errors in Environment init * fix: add truncateMessage to avoid db explosion * cleanup: better lifecycle management * fix: init status at the beginning of installation * optimize: GracefulStop for pluginInstance * refactor: tests * refactor: centralize routine labels (#504) * cleanup: RoutineKey * fix: init routine pool * fix: correctly handle cluster register error * fix: memory leak * fix: add \n to instance write * fix(installer.go): set success to true after succeed for defer func * refactor * fix: missing cwd in testutils * fix: scaleup default runtime nums to 1 when testing * fix: localruntime appconfig in testing module * Update internal/core/local_runtime/load_balancing.go Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * fix: more efficiency implement in installer_local.go * fix: returns after failing in onDebuggingRuntimeDisconnected * fix: returns after failing in onDebuggingRuntimeDisconnected * fix: splits tests * refactor: naming * refactor: manifest.VersionX * fix: adapt SetDefault to tests * fix: enforce use constants in DBType * fix: generate * fix: linter * cleanup tests * refactor: change package to * cleanup: useless codes * Update internal/cluster/plugin.go Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * cleanup * refactor: decouple connection_key management from debugging_time * refactor: confused naming * feat: recycle resources to adapt to https://github.com/langgenius/dify-plugin-daemon/pull/500 * refactor: confusing redirecting * fix: support get serverless runtime * fix: race condition in Launching * fix: avoid ManifestValidate in first step of debugging handshake * fix: adding ReleaseAllLocks to finalizers * wtf: what a beautiful code * refactor: rename Stream.Async to Stream.Process * fix: kill process if daed instance was detected * fix: correctly handle failures * fix: consistence of difference interfaces * fix: add stacktrace to panic * fix: only trigger once event * fix: ensure plugin runtime was shutdown * feat: cleanup install tasks * fix: add scale logs --------- Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> |
||
|
Maries
|
4589841b0c |
feat: introduce trigger (#482)
* feat(plugins): add FetchPluginReadme endpoint and update launch configurations * feat: add PluginReadme database model * feat: implement readme extracting and storage * feat: implement readme endpoint * feat: add plugin asset extraction endpoint with caching support * Implement trigger functionality and clean up dynamic select code - Added new trigger-related access types and actions in access.go. - Introduced new HTTP routes for trigger operations in http_server.gen.go. - Updated plugin declaration to include triggers in plugin_entities. - Removed unused dynamic select service and controller files. - Enhanced message handling in debugging_runtime to support trigger registration. This update enhances the plugin system by integrating trigger capabilities while cleaning up legacy code. * Refactor trigger-related types and enhance dynamic select functionality - Updated TriggerProviderIdentity and TriggerProviderConfiguration to improve structure and validation. - Renamed TriggerConfiguration to TriggerDeclaration for clarity. - Added CredentialType to RequestDynamicParameterSelect for better request handling. - Enhanced PluginDecoderHelper to read and unmarshal trigger files correctly. These changes streamline the trigger system and improve the overall request handling in the plugin architecture. * Add trigger functionality and enhance database integration - Introduced TriggerInstallation model for managing trigger installations in the database. - Updated autoMigrate function to include trigger installations in the migration process. - Added new HTTP routes for listing and retrieving triggers in the HTTP server. - Implemented ListTriggers and GetTrigger controller functions for handling trigger requests. - Enhanced plugin management functions to create, update, and delete trigger installations during plugin lifecycle events. These changes integrate trigger capabilities into the system, improving the overall plugin functionality and management. * feat: add remapping for trigger icons in MediaBucket - Enhanced the RemapAssets function to include remapping of trigger identity icons and dark icons. - Added error handling for remapping failures to ensure robust asset management. These changes improve the handling of trigger assets within the plugin system, ensuring icons are correctly remapped as needed. * feat: add Multiple field to TriggerParameter for enhanced configuration - Introduced a new Multiple field in the TriggerParameter struct to allow for multiple values in trigger configurations. - This addition improves the flexibility of trigger parameters within the plugin system. These changes enhance the capability of trigger parameters, enabling more complex configurations. * feat: add Multiple field to ProviderConfig for enhanced configuration - Introduced a new Multiple field in the ProviderConfig struct to allow for multiple values in provider configurations. - This addition improves the flexibility of provider options within the plugin system. These changes enhance the capability of provider configurations, enabling more complex setups. * fix(plugin): update validation error messages in ManifestValidate method - Enhanced error messages in the ManifestValidate function to include 'trigger' in the validation checks for plugin declarations. - Updated logic to ensure that all relevant fields are considered when validating the presence of mutually exclusive parameters. * feat(trigger): add CHECKBOX parameter type to plugin entities and refactor the trigger provider strcuture - Introduced a new CHECKBOX parameter type in constant.go for plugin entities. - Updated tool_declaration.go and trigger_declaration.go to include TOOL_PARAMETER_TYPE_CHECKBOX and TRIGGER_PARAMETER_TYPE_CHECKBOX respectively. - Enhanced validation logic to accommodate the new CHECKBOX type in parameter checks. * fix(trigger): update SubscriptionSchema validation in TriggerProviderDeclaration - Changed SubscriptionSchema validation from 'omitempty' to 'required' in TriggerProviderDeclaration to ensure it is always provided. - Updated SubscriptionConstructor field to be a pointer to allow for optional inclusion in the trigger provider configuration. * fix(trigger): rename ParametersSchema to Parameters in SubscriptionConstructor - Updated the SubscriptionConstructor struct to rename the ParametersSchema field to Parameters for consistency. - Adjusted related JSON and YAML marshaling logic to reflect the new field name, ensuring proper handling of trigger parameters. * refactor(trigger): enhance YAML unmarshalling for SubscriptionConstructor and SubscriptionSchema - Introduced a new helper function to convert YAML nodes to ProviderConfig lists, improving the handling of subscription_schema and credentials_schema. - Updated the UnmarshalYAML method to utilize the new function, simplifying the logic for parsing different YAML formats. - Ensured proper initialization of SubscriptionConstructor fields to prevent nil pointer dereferences. * fix(trigger): update SubscriptionConstructor validation in TriggerProviderDeclaration - Changed the validation for SubscriptionConstructor in TriggerProviderDeclaration from 'omitempty,dive' to 'omitempty' to simplify the validation logic. - Ensured that the SubscriptionConstructor field remains optional while maintaining its intended functionality. * refactor(trigger): rename Trigger to Event in plugin entities and related structures - Updated the naming conventions in trigger_declaration.go to replace 'Trigger' with 'Event' for better clarity and consistency. - Adjusted related types, validation functions, and unmarshalling logic to reflect the new 'Event' terminology. - Ensured that all references to triggers in the codebase are updated to events, including in the SubscriptionConstructor and response structures. * refactor(trigger): rename TriggerInvoke to TriggerInvokeEvent and update related structures - Renamed TriggerInvoke function and associated request/response types to TriggerInvokeEvent for improved clarity. - Updated routing and controller methods to reflect the new naming convention. - Ensured all references to the trigger invoke functionality are consistent with the new event terminology. * refactor(trigger): remove Subscription struct from trigger_declaration.go and update TriggerDispatchEventRequest - Removed the Subscription struct from trigger_declaration.go to streamline the codebase. - Added Credentials field to TriggerDispatchEventRequest for enhanced functionality and clarity. - Ensured that the changes maintain consistency with the existing naming conventions and structures. * fix(trigger): improve nil checks for SubscriptionConstructor in TriggerProviderDeclaration - Added nil checks for SubscriptionConstructor before accessing its fields to prevent potential nil pointer dereferences. - Ensured that Parameters and CredentialsSchema are initialized only if SubscriptionConstructor is not nil, enhancing code robustness. * fix(plugin): add recovery mechanism in OnTraffic to handle panics - Introduced a deferred function in OnTraffic to recover from panics, logging the error and stack trace for better debugging. - This enhancement improves the stability of the DifyServer by preventing crashes due to unexpected runtime errors. * feat(trigger): add Subscription field to TriggerInvokeEventRequest - Introduced a new Subscription field in the TriggerInvokeEventRequest struct to accommodate subscription data. - Ensured the field is marked as required, enhancing the request's functionality and validation requirements. * refactor(event): simplify EventDescription structure in EventDeclaration - Removed the EventDescription struct and replaced it with a direct I18nObject field in EventDeclaration. - This change streamlines the event configuration by reducing complexity while maintaining required validation for the description. * feat(trigger): add UserID field to TriggerDispatchEventResponse - Introduced a new UserID field in the TriggerDispatchEventResponse struct to include user identification in the response. - The field is marked as optional, enhancing the response's flexibility while maintaining existing functionality. * feat: add payload to TriggerDispatchEventResponse * fix * feat(trigger): update TriggerDispatchEventResponse structure * fix: avoid path collusion * fix: missing ) * fix: query param * fix: form param * fix: remove redundant dynamic parameter access type * fix: remove dynamic parameter access type from validation * Update internal/server/controllers/plugins.go Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> --------- Co-authored-by: Stream <Stream_2@qq.com> Co-authored-by: Yeuoly <admin@srmxy.cn> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> |
||
|
Yeuoly
|
878edde455 |
feat(datasource): Implement datasource validation and invocation steps (#295)
* feat(datasource): Implement datasource validation and invocation steps - Added new functionality for validating datasource credentials and invoking the first and second steps of the datasource process. - Introduced new API endpoints for datasource operations in the HTTP server. - Created corresponding service and controller methods to handle datasource requests. - Defined new request and response structures for datasource operations in the entities package. * feat: add routes * feat(datasource): Add initial datasource models and validation - Introduced new `DatasourceInstallation` model to represent datasource installations with relevant fields. - Created `datasource.go` file for future datasource service implementation. - Enhanced `datasource_declaration.go` with new types and validation functions for datasource provider and parameters. - Updated `plugin_declaration.go` to include datasource support in plugin structures. - Refactored `agent_declaration.go` and `tool_declaration.go` to use a unified `ParameterOption` type for options. * refactor(datasource): Update request and response types for online document content retrieval - Renamed and updated request and response types for the `DatasourceGetOnlineDocumentPageContent` function to improve clarity and consistency. - Introduced `RequestInvokeOnlineDocumentDatasourceGetContent` and `DatasourceInvokeOnlineDocumentGetContentResponse` types. - Adjusted related function signatures and dispatchers to reflect the new types across the datasource service and controller implementations. * feat(datasource): Implement datasource installation handling - Added functionality to create and update `DatasourceInstallation` records during plugin installation and upgrade processes. - Enhanced the `InstallPlugin` function to create a new datasource installation if a datasource declaration is present. - Updated the `UpgradePlugin` function to handle the deletion of the original datasource installation and creation of a new one if the datasource declaration changes. * feat(datasource): Add datasource registration handling in plugin runtime - Introduced handling for datasource declarations in the plugin runtime. - Updated `RemotePluginRuntime` to track datasource registration status. - Enhanced message processing to include validation and assignment of datasource declarations. * feat(datasource): Implement datasource listing and retrieval endpoints - Added `ListDatasources` and `GetDatasource` functions to the service layer for handling datasource queries. - Created corresponding controller methods to process HTTP requests for listing and retrieving datasources. - Implemented request validation for tenant ID, page, page size, plugin ID, and provider parameters. * add datasource routes * feat(datasource): Add icon remapping for datasource declarations - Implemented functionality to remap icons for both the main datasource and its individual datasources within the plugin declaration. - Enhanced error handling to provide clearer feedback when remapping fails. * fix(datasource): update OAuthSchema validation to remove unnecessary 'dive' tag - Modified the validation tag for OAuthSchema in DatasourceProviderDeclaration to simplify the validation process by removing the 'dive' requirement. * feat(tests): add datasource declaration parsing and output - Introduced a new main.go file for testing datasource declaration parsing. - Implemented JSON unmarshalling for RemotePluginRegisterPayload and DatasourceProviderDeclaration. - Added a sample datasource declaration for testing purposes. * fix(plugin): improve error handling in UninstallPlugin and add datasource deletion - Enhanced error handling to return a specific message when a plugin is not installed. - Added functionality to delete the associated datasource installation during the uninstallation process. * feat(datasource): add support for decoding datasource provider declaration - Added custom JSON marshalling and unmarshalling methods to handle CredentialsSchema and Datasources more effectively. - Improved error handling during YAML unmarshalling to support both object and array formats for CredentialsSchema. - Ensured proper initialization of DatasourceFiles and Tags to prevent nil references. * fix: provider type * refactor(datasource): simplify JSON unmarshalling for CredentialsSchema - Removed complex handling of CredentialsSchema in the UnmarshalJSON method, focusing on the Datasources field. - Streamlined the code to improve readability and maintainability by eliminating unnecessary checks and logic related to CredentialsSchema. * feat: streaming datasource * feat: datasource * feat: datasource * feat:datasource * feat:datasource * feat:datasource * feat: add redirect_uri field to OAuth request structs * feat: add online driver file request and response structures * feat: add online driver file request and response structures * feat: add online_driver datasource type to validation * feat: rename online driver to online drive and update related classes and methods :) * refactor: rename OnlineDocumentPageChunk to DatasourceGetPagesResponse and update related references * feat: update request types for online drive browsing and downloading * feat: add metadata field to OAuthGetCredentialsResult * feat: built-in json schema definations * feat(plugin_entities): add built-in schema definitions and processing for datasource YAML * test(plugin_entities): add unit tests for schema definitions and YAML processing * refactor(plugin_entities): centralize built-in schema definitions and processing * refactor(plugin_entities): remove unused properties from built-in schema definitions * refactor(plugin_entities): built-in schema & new datasource structure * refactor(plugin_entities): enhance schema processing with checks and error handling * refactor(plugin_entities): update validation for OnlineDriveBrowseFilesRequest prefix field to be optional * refactor(json_schema): remove json schema definitions and validation * fix(plugin_entities): remove output_schema validation tests * feat: add rag tag --------- Co-authored-by: Harry <xh001x@hotmail.com> Co-authored-by: Dongyu Li <544104925@qq.com> Co-authored-by: Novice <novice12185727@gmail.com> |
||
|
Yeuoly
|
b97cce7167 |
enhance(cli/icon): add multiple categories default plugin icons (#388)
* feat: add support for dark icon - Introduced IconDark field in PluginDeclaration and related structures to support dark mode icons. - Updated the installation process to handle dark icons. - Enhanced asset validation to check for the presence of dark icons. This change improves the visual consistency of plugins in dark mode environments. * enhance(cli/icon): add plugin icon support with multiple categories - Added support for light and dark icons for various plugin categories including agent, datasource, extension, model, tool, and trigger. - Replaced the previous single icon implementation with a structured map for better organization and retrieval of icons based on category and theme. - Removed the old Python icon file to streamline asset management. This update improves the visual representation of plugins across different themes, enhancing user experience. * change icons * fix * fix * comments |
||
|
Yeuoly
|
d02885674a |
feat: add repository URL support for plugin manifest (#262)
* feat: add repository URL support for plugin manifest - Introduced a new optional flag for specifying the plugin repository URL during initialization. - Updated the InitPluginWithFlags function to handle the new repository parameter. - Enhanced profile management to include repository input. - Modified related tests to validate the new repository functionality. * fix: improve input validation in profile checkRule method - Updated the checkRule method to ensure cursor is within valid range before checking for empty input values. This change prevents potential out-of-bounds errors and enhances the robustness of the input validation process. |
||
|
Yeuoly
|
c952664139 |
Feat/support minimal dify version required (#203)
* feat(plugin): add version requirement functionality to plugin initialization - Introduced a new `version_require` sub-menu to handle minimal Dify version input. - Updated the plugin initialization process to include the new version requirement. - Enhanced the `PluginMeta` struct to store the minimal Dify version. - Added validation for the minimal Dify version input to ensure correctness. * fix(plugin): rename MinimalDifyVersion to MinimumDifyVersion for consistency - Updated the `PluginMeta` struct to change the field name from `MinimalDifyVersion` to `MinimumDifyVersion`. - Adjusted the plugin initialization logic to reflect the new field name, ensuring proper handling of version requirements. |
||
|
Yeuoly
|
fc3cba5f2c | fix: add Plugins.* to PluginDeclaration.Category() | ||
|
Yeuoly
|
0f94beb9ff | feat: add command line support to agent | ||
|
Yeuoly
|
15060ee312 | refactor: move entities to pkg |