langgenius/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-07-21 20:15:31 -04:00
Code Issues 775 Packages Projects Releases 10 Wiki Activity

[PR #29494] feat: clear free plan workflow run logs #32438

New Issue
Closed
opened 2026-02-21 20:51:24 -05:00 by yindo · 0 comments
yindo commented 2026-02-21 20:51:24 -05:00
Owner
Copy Link
Copy Source

Original Pull Request: https://github.com/langgenius/dify/pull/29494

State: closed
Merged: Yes

Important

  1. Make sure you have read our contribution guidelines
  2. Ensure there is an associated issue and you have been assigned to it
  3. Use the correct syntax to link this PR: Fixes #<issue number>.

Summary

fix https://github.com/langgenius/dify/issues/29776

related PR:
https://github.com/langgenius/dify/pull/29842
https://github.com/langgenius/dify/pull/29829
https://github.com/langgenius/dify/pull/29638

Todo:
rm api/services/clear_free_plan_tenant_expired_logs.py in the future.

Usage

1. update db

to use the created_at index of workflow_runs table

flask db upgrade

2. dry run

flask clean-workflow-runs --start-from="2024-01-01" --end-before="2024-01-31" --dry-run

then you can get some logs like:

...
Dry run complete. Would delete 2024 workflow runs between 2014-01-01T00:00:00 and 2024-01-02T00:00:00; related records: node_executions 2022, offloads 6066, app_logs 2024, trigger_logs 2022, pauses 2022, pause_reasons 2022

you can compare with the sql result (maybe slow):

WITH params AS (
    SELECT 
        TIMESTAMP '2024-01-01 00:00:00' AS start_after,
        TIMESTAMP '2024-01-31 00:00:00' AS end_before
)
SELECT 'workflow_runs' AS table_name, COUNT(*) AS record_count 
FROM workflow_runs, params 
WHERE created_at >= start_after AND created_at < end_before

UNION ALL
SELECT 'workflow_node_executions', COUNT(*) 
FROM workflow_node_executions, params 
WHERE created_at >= start_after AND created_at < end_before

UNION ALL
SELECT 'workflow_node_execution_offload', COUNT(*) 
FROM workflow_node_execution_offload, params 
WHERE created_at >= start_after AND created_at < end_before

UNION ALL
SELECT 'workflow_app_logs', COUNT(*) 
FROM workflow_app_logs, params 
WHERE created_at >= start_after AND created_at < end_before

UNION ALL
SELECT 'workflow_trigger_logs', COUNT(*) 
FROM workflow_trigger_logs, params 
WHERE created_at >= start_after AND created_at < end_before

UNION ALL
SELECT 'workflow_pauses', COUNT(*) 
FROM workflow_pauses, params 
WHERE created_at >= start_after AND created_at < end_before

UNION ALL
SELECT 'workflow_pause_reasons', COUNT(*) 
FROM workflow_pause_reasons, params 
WHERE created_at >= start_after AND created_at < end_before

ORDER BY table_name;

4. run

To clear run logs within a specified time range.

flask clean-workflow-runs --start-from="2024-01-01" --end-before="2024-01-31"

To clear the run logs before 90 days:

flask clean-workflow-runs --days=90

To schedule run the clear task:

ENABLE_WORKFLOW_RUN_CLEANUP_TASK=true

Screenshots

Before After
... ...

Checklist

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
**Original Pull Request:** https://github.com/langgenius/dify/pull/29494 **State:** closed **Merged:** Yes --- > [!IMPORTANT] > > 1. Make sure you have read our [contribution guidelines](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) > 1. Ensure there is an associated issue and you have been assigned to it > 1. Use the correct syntax to link this PR: `Fixes #<issue number>`. ## Summary <!-- Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change. --> fix https://github.com/langgenius/dify/issues/29776 related PR: https://github.com/langgenius/dify/pull/29842 https://github.com/langgenius/dify/pull/29829 https://github.com/langgenius/dify/pull/29638 Todo: rm `api/services/clear_free_plan_tenant_expired_logs.py` in the future. ## Usage #### 1. update db to use the `created_at` index of `workflow_runs` table ``` flask db upgrade ``` #### 2. dry run ``` flask clean-workflow-runs --start-from="2024-01-01" --end-before="2024-01-31" --dry-run ``` then you can get some logs like: ``` ... Dry run complete. Would delete 2024 workflow runs between 2014-01-01T00:00:00 and 2024-01-02T00:00:00; related records: node_executions 2022, offloads 6066, app_logs 2024, trigger_logs 2022, pauses 2022, pause_reasons 2022 ``` you can compare with the sql result (maybe slow): ``` WITH params AS ( SELECT TIMESTAMP '2024-01-01 00:00:00' AS start_after, TIMESTAMP '2024-01-31 00:00:00' AS end_before ) SELECT 'workflow_runs' AS table_name, COUNT(*) AS record_count FROM workflow_runs, params WHERE created_at >= start_after AND created_at < end_before UNION ALL SELECT 'workflow_node_executions', COUNT(*) FROM workflow_node_executions, params WHERE created_at >= start_after AND created_at < end_before UNION ALL SELECT 'workflow_node_execution_offload', COUNT(*) FROM workflow_node_execution_offload, params WHERE created_at >= start_after AND created_at < end_before UNION ALL SELECT 'workflow_app_logs', COUNT(*) FROM workflow_app_logs, params WHERE created_at >= start_after AND created_at < end_before UNION ALL SELECT 'workflow_trigger_logs', COUNT(*) FROM workflow_trigger_logs, params WHERE created_at >= start_after AND created_at < end_before UNION ALL SELECT 'workflow_pauses', COUNT(*) FROM workflow_pauses, params WHERE created_at >= start_after AND created_at < end_before UNION ALL SELECT 'workflow_pause_reasons', COUNT(*) FROM workflow_pause_reasons, params WHERE created_at >= start_after AND created_at < end_before ORDER BY table_name; ``` #### 4. run To clear run logs within a specified time range. ``` flask clean-workflow-runs --start-from="2024-01-01" --end-before="2024-01-31" ``` To clear the run logs before 90 days: ``` flask clean-workflow-runs --days=90 ``` To schedule run the clear task: ``` ENABLE_WORKFLOW_RUN_CLEANUP_TASK=true ``` ## Screenshots | Before | After | |--------|-------| | ... | ... | ## Checklist - [ ] This change requires a documentation update, included: [Dify Document](https://github.com/langgenius/dify-docs) - [x] I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!) - [x] I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change. - [x] I've updated the documentation accordingly. - [x] I ran `dev/reformat`(backend) and `cd web && npx lint-staged`(frontend) to appease the lint gods
yindo added the pull-request label 2026-02-21 20:51:24 -05:00
yindo closed this issue 2026-02-21 20:51:24 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Knowledge Pipeline
Proposal
WIP
cloud
dependencies
feat:webapp
good first issue
outdated
performance
pull-request
Mirrored from GitHub Pull Request
 python:uv
refactor
size:L
stale
status: accepting prs
status: blocked
status: in discussion
stt & tts
vulnerablity
web
wont-fix
🌊 feat:workflow
🌚 invalid
🐞 bug
👻 feat:rag
💪 enhancement
📚 documentation
🔨 feat:tools
🙋‍♂️ question
🙏 help wanted
🤔 cant-reproduce
🤖 feat:agent
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#32438
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?