Weaviate start up failed #828

Closed
opened 2026-02-21 17:28:37 -05:00 by yindo · 1 comment
Owner

Originally created by @shelltea on GitHub (Dec 21, 2023).

Self Checks

Dify version

0.3.34

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

2023-12-21 18:11:31 {"action":"inverted filter2search migration","error":"failed moving orig bucket dir '/var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable': rename /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable___del: permission denied","index":"vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node","level":"error","msg":"failed migrating shard","shard":"vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d","time":"2023-12-21T10:11:31Z"}
2023-12-21 18:11:31 {"action":"inverted filter2search migration","error":"failed migrating shard: failed moving orig bucket dir '/var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable': rename /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable___del: permission denied","index":"vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node","level":"error","msg":"failed migrating class","time":"2023-12-21T10:11:31Z"}
2023-12-21 18:11:31 {"action":"inverted filter2search migration","error":"failed migrating class: failed migrating shard: failed moving orig bucket dir '/var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable': rename /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable___del: permission denied","level":"error","msg":"failed migrating classes","time":"2023-12-21T10:11:31Z"}
2023-12-21 18:11:31 {"action":"adjustFilterablePropSettings","error":"failed migrating classes: failed migrating class: failed migrating shard: failed moving orig bucket dir '/var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable': rename /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable___del: permission denied","level":"fatal","msg":"migration failed","time":"2023-12-21T10:11:31Z"}

✔️ Expected Behavior

Container docker-weaviate-1 can start up normally.

Actual Behavior

docker-weaviate-1 start up failed.

image
Originally created by @shelltea on GitHub (Dec 21, 2023). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to file this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). ### Dify version 0.3.34 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce ```log 2023-12-21 18:11:31 {"action":"inverted filter2search migration","error":"failed moving orig bucket dir '/var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable': rename /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable___del: permission denied","index":"vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node","level":"error","msg":"failed migrating shard","shard":"vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d","time":"2023-12-21T10:11:31Z"} 2023-12-21 18:11:31 {"action":"inverted filter2search migration","error":"failed migrating shard: failed moving orig bucket dir '/var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable': rename /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable /var/lib/weaviate/vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node_xnKDGG9a7i8d_lsm/property_document_id_searchable___del: permission denied","index":"vector_index_6facf57d_b514_49c6_861f_2e520f521ccf_node","level":"error","msg":"failed migrating class","time":"2023-12-21T10:11:31Z"} 2023-12-21 18:11:31 {"action":"inverted filter2search migration","error":"failed migrating class: failed migrating shard: failed moving orig bucket dir '/var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable': rename /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable___del: permission denied","level":"error","msg":"failed migrating classes","time":"2023-12-21T10:11:31Z"} 2023-12-21 18:11:31 {"action":"adjustFilterablePropSettings","error":"failed migrating classes: failed migrating class: failed migrating shard: failed moving orig bucket dir '/var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable': rename /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable /var/lib/weaviate/vector_index_95a866f5_2a80_4e13_ad56_78c2f06224eb_node_It4pqbFGfupj_lsm/property_doc_id_searchable___del: permission denied","level":"fatal","msg":"migration failed","time":"2023-12-21T10:11:31Z"} ``` ### ✔️ Expected Behavior Container `docker-weaviate-1` can start up normally. ### ❌ Actual Behavior `docker-weaviate-1` start up failed. <img width="1251" alt="image" src="https://github.com/langgenius/dify/assets/864375/96366dde-ab3d-47cd-a35d-fc41edbcac7d">
yindo added the 🐞 bug label 2026-02-21 17:28:37 -05:00
yindo closed this issue 2026-02-21 17:28:37 -05:00
Author
Owner

@crazywoola commented on GitHub (Dec 21, 2023):

The error messages you're encountering with Weaviate suggest an issue related to file system permissions. Specifically, the error:

failed moving orig bucket dir '...': rename ...: permission denied

indicates that the Weaviate process does not have sufficient permissions to rename or move certain directories on your filesystem. This is typically a problem with the user permissions under which the Weaviate service is running. Here are some steps to resolve this issue:

  1. Check Running User: Ensure that Weaviate is running under a user account that has sufficient permissions to access and modify the files and directories in the mentioned paths (e.g., /var/lib/weaviate/...).

  2. Adjust Permissions: If the permissions are restricted, you may need to adjust them. This can be done using the chown and chmod commands on Unix/Linux systems. For example, you could use chown to change the ownership of the directory to the user running Weaviate, and chmod to ensure the necessary read, write, and execute permissions.

  3. File System Checks: Ensure there are no underlying issues with the file system, such as it being read-only, full, or having other integrity issues.

  4. Check Weaviate Configuration: Review the Weaviate configuration to ensure that the paths and other settings are correctly specified.

  5. Restart Weaviate: After making the necessary changes, restart the Weaviate service to apply these changes.

  6. Consult Documentation/Support: If the problem persists, refer to Weaviate's documentation or seek support from their community or support channels for more specific guidance.

Remember to perform these actions with caution, especially when changing permissions and ownership, as incorrect settings can affect the security and stability of your system.

@crazywoola commented on GitHub (Dec 21, 2023): The error messages you're encountering with Weaviate suggest an issue related to file system permissions. Specifically, the error: ``` failed moving orig bucket dir '...': rename ...: permission denied ``` indicates that the Weaviate process does not have sufficient permissions to rename or move certain directories on your filesystem. This is typically a problem with the user permissions under which the Weaviate service is running. Here are some steps to resolve this issue: 1. **Check Running User**: Ensure that Weaviate is running under a user account that has sufficient permissions to access and modify the files and directories in the mentioned paths (e.g., `/var/lib/weaviate/...`). 2. **Adjust Permissions**: If the permissions are restricted, you may need to adjust them. This can be done using the `chown` and `chmod` commands on Unix/Linux systems. For example, you could use `chown` to change the ownership of the directory to the user running Weaviate, and `chmod` to ensure the necessary read, write, and execute permissions. 3. **File System Checks**: Ensure there are no underlying issues with the file system, such as it being read-only, full, or having other integrity issues. 4. **Check Weaviate Configuration**: Review the Weaviate configuration to ensure that the paths and other settings are correctly specified. 5. **Restart Weaviate**: After making the necessary changes, restart the Weaviate service to apply these changes. 6. **Consult Documentation/Support**: If the problem persists, refer to Weaviate's documentation or seek support from their community or support channels for more specific guidance. Remember to perform these actions with caution, especially when changing permissions and ownership, as incorrect settings can affect the security and stability of your system.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#828