duplicate data in datasets pagination list #17523

Closed
opened 2026-02-21 19:36:25 -05:00 by yindo · 0 comments
Owner

Originally created by @zlyszx on GitHub (Sep 16, 2025).

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.8.0

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

When querying the paginated list of the datasets, a certain piece of data appears repeatedly on the first page and the second page.

code:
Image
output:
Image

✔️ Expected Behavior

The returned paginated data should not contain duplicates.

Actual Behavior

Different pages have duplicate data.

Originally created by @zlyszx on GitHub (Sep 16, 2025). ### Self Checks - [x] I have read the [Contributing Guide](https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md) and [Language Policy](https://github.com/langgenius/dify/issues/1542). - [x] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [x] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :) - [x] Please do not modify this template :) and fill in all the required fields. ### Dify version 1.8.0 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce When querying the paginated list of the datasets, a certain piece of data appears repeatedly on the first page and the second page. code: <img width="835" height="608" alt="Image" src="https://github.com/user-attachments/assets/4e14981d-8690-434f-9530-0c0d676d770c" /> output: <img width="650" height="123" alt="Image" src="https://github.com/user-attachments/assets/d2baf3bd-59dc-477f-b641-83043f7fc504" /> ### ✔️ Expected Behavior The returned paginated data should not contain duplicates. ### ❌ Actual Behavior Different pages have duplicate data.
yindo added the 🐞 bug label 2026-02-21 19:36:25 -05:00
yindo closed this issue 2026-02-21 19:36:25 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#17523