[PR #22371] chore: add SQLALCHEMY_POOL_USE_LIFO option and missing SQLALCHEMY_POOL_PRE_PING env default value. #29911

Closed
opened 2026-02-21 20:46:29 -05:00 by yindo · 0 comments
Owner

Original Pull Request: https://github.com/langgenius/dify/pull/22371

State: closed
Merged: Yes


Important

  1. Make sure you have read our contribution guidelines
  2. Ensure there is an associated issue and you have been assigned to it
  3. Use the correct syntax to link this PR: Fixes #<issue number>.

Summary

Fixes #22307

Screenshots

As I mentioned in the issue, while it disabled LIFO (then it's FIFO by default), the opened connections for 100 requests are:

(base) ➜  ~ grep "connection opened" without-lifo-conn.log|wc -l
     170
(base) ➜  ~ grep "connection opened" without-lifo-conn-2-time.log|wc -l
     134

And when we enabled it, the connection number decreased:

(base) ➜  ~ grep "connection opened" with-lifo-conn.log|wc -l
     128
(base) ➜  ~ grep "connection opened" with-lifo-conn-2-time.log|wc -l
     113

The SQLAlchemy document also shared a key information, which means we could recycle more stale connections while choose LIFO:

use LIFO (last-in-first-out) when retrieving connections from [QueuePool](https://docs.sqlalchemy.org/en/20/core/pooling.html#sqlalchemy.pool.QueuePool) instead of FIFO (first-in-first-out). Using LIFO, a server-side timeout scheme can reduce the number of connections used during non- peak periods of use. When planning for server-side timeouts, ensure that a recycle or pre-ping strategy is in use to gracefully handle stale connections.

Checklist

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
**Original Pull Request:** https://github.com/langgenius/dify/pull/22371 **State:** closed **Merged:** Yes --- > [!IMPORTANT] > > 1. Make sure you have read our [contribution guidelines](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) > 2. Ensure there is an associated issue and you have been assigned to it > 3. Use the correct syntax to link this PR: `Fixes #<issue number>`. ## Summary <!-- Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change. --> Fixes #22307 ## Screenshots As I mentioned in the issue, while it disabled LIFO (then it's FIFO by default), the opened connections for 100 requests are: ``` (base) ➜ ~ grep "connection opened" without-lifo-conn.log|wc -l 170 (base) ➜ ~ grep "connection opened" without-lifo-conn-2-time.log|wc -l 134 ``` And when we enabled it, the connection number decreased: ``` (base) ➜ ~ grep "connection opened" with-lifo-conn.log|wc -l 128 (base) ➜ ~ grep "connection opened" with-lifo-conn-2-time.log|wc -l 113 ``` The [SQLAlchemy document](https://docs.sqlalchemy.org/en/20/core/engines.html#sqlalchemy.create_engine.params.pool_use_lifo) also shared a key information, which means we could recycle more stale connections while choose LIFO: ``` use LIFO (last-in-first-out) when retrieving connections from [QueuePool](https://docs.sqlalchemy.org/en/20/core/pooling.html#sqlalchemy.pool.QueuePool) instead of FIFO (first-in-first-out). Using LIFO, a server-side timeout scheme can reduce the number of connections used during non- peak periods of use. When planning for server-side timeouts, ensure that a recycle or pre-ping strategy is in use to gracefully handle stale connections. ``` ## Checklist - [ ] This change requires a documentation update, included: [Dify Document](https://github.com/langgenius/dify-docs) - [x] I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!) - [x] I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change. - [x] I've updated the documentation accordingly. - [x] I ran `dev/reformat`(backend) and `cd web && npx lint-staged`(frontend) to appease the lint gods
yindo added the pull-request label 2026-02-21 20:46:29 -05:00
yindo closed this issue 2026-02-21 20:46:29 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#29911