[PR #11796] fix: better memory usage from 800+ to 500+ #27366

Closed
opened 2026-02-21 20:41:23 -05:00 by yindo · 0 comments
Owner

Original Pull Request: https://github.com/langgenius/dify/pull/11796

State: closed
Merged: Yes


Summary

with this patch
image

without this patch

image

how to trace the memory

  1. use https://github.com/bloomberg/memray
  2. run memray run app.py and memray run app.py --debug
  3. read the flamegraph found some big memory are from some package like google and jieba
  4. lazy import them to better the memory usage and short the start time

flamegraph without this patch
image

flamegraph with this patch
image

Tip

Close issue syntax: Fixes #<issue number> or Resolves #<issue number>, see documentation for more details.

Screenshots

Before After
... ...

Checklist

Important

Please review the checklist below before submitting your pull request.

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
**Original Pull Request:** https://github.com/langgenius/dify/pull/11796 **State:** closed **Merged:** Yes --- # Summary with this patch ![image](https://github.com/user-attachments/assets/bcec3e0b-d29c-429c-9133-0fec6e15d45a) without this patch ![image](https://github.com/user-attachments/assets/5eb253ec-6158-4c56-9152-837b8d65de0b) how to trace the memory 1. use https://github.com/bloomberg/memray 2. run `memray run app.py` and `memray run app.py --debug` 3. read the flamegraph found some big memory are from some package like google and jieba 4. lazy import them to better the memory usage and short the start time flamegraph without this patch ![image](https://github.com/user-attachments/assets/61c69b08-d776-4fb8-b17d-6b4432f90140) flamegraph with this patch ![image](https://github.com/user-attachments/assets/68faaafa-05a4-43ce-be31-9c873f6cefe2) > [!Tip] > Close issue syntax: `Fixes #<issue number>` or `Resolves #<issue number>`, see [documentation](https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword) for more details. # Screenshots | Before | After | |--------|-------| | ... | ... | # Checklist > [!IMPORTANT] > Please review the checklist below before submitting your pull request. - [ ] This change requires a documentation update, included: [Dify Document](https://github.com/langgenius/dify-docs) - [x] I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!) - [x] I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change. - [x] I've updated the documentation accordingly. - [x] I ran `dev/reformat`(backend) and `cd web && npx lint-staged`(frontend) to appease the lint gods
yindo added the pull-request label 2026-02-21 20:41:23 -05:00
yindo closed this issue 2026-02-21 20:41:23 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#27366