[PR #19192] fix: time type metadata filtering error #29092

Closed
opened 2026-02-21 20:44:51 -05:00 by yindo · 0 comments
Owner

Original Pull Request: https://github.com/langgenius/dify/pull/19192

State: closed
Merged: Yes


Summary

fixed: #19191

I've figured out what triggered this issue.
documents.doc_metadata field stored float timestamp, but the query uses an integer type cast.

sqlalchemy_cast(DatasetDocument.doc_metadata[metadata_name].astext, Integer) < value 

This line of code triggers an exception.

I think there are two ways to solve this problem:

One is to use Integer type when storing timestamp into doc_metadata field.
The second is to use float type when executing pg query.
But the former is not compatible with existing doc_metadata data, or we need a script to cast old data.

Screenshots

Before After
... ...

Checklist

Important

Please review the checklist below before submitting your pull request.

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods
**Original Pull Request:** https://github.com/langgenius/dify/pull/19192 **State:** closed **Merged:** Yes --- # Summary fixed: #19191 I've figured out what triggered this issue. `documents.doc_metadata` field stored `float` timestamp, but the query uses an `integer` type cast. ```python sqlalchemy_cast(DatasetDocument.doc_metadata[metadata_name].astext, Integer) < value ``` This line of code triggers an exception. I think there are two ways to solve this problem: One is to use Integer type when storing timestamp into `doc_metadata` field. The second is to use float type when executing pg query. But the former is not compatible with existing `doc_metadata` data, or we need a script to cast old data. # Screenshots | Before | After | |--------|-------| | ... | ... | # Checklist > [!IMPORTANT] > Please review the checklist below before submitting your pull request. - [ ] This change requires a documentation update, included: [Dify Document](https://github.com/langgenius/dify-docs) - [x] I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!) - [x] I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change. - [x] I've updated the documentation accordingly. - [x] I ran `dev/reformat`(backend) and `cd web && npx lint-staged`(frontend) to appease the lint gods
yindo added the pull-request label 2026-02-21 20:44:51 -05:00
yindo closed this issue 2026-02-21 20:44:51 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#29092