Configuration Issue with OpenDAL S3 Setup in Version 0.14.2 #7438

Closed
opened 2026-02-21 18:20:35 -05:00 by yindo · 3 comments
Owner

Originally created by @lukefan on GitHub (Dec 29, 2024).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.14.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I am currently working with OpenDAL version 0.14.2 and have encountered an issue regarding the S3 configuration. After setting the storage type to S3 in the .env file, I understand that the following environment variables need to be configured:

OPENDAL_S3_ENDPOINT
OPENDAL_S3_REGION
OPENDAL_S3_BUCKET
OPENDAL_S3_ACCESS_KEY_ID
OPENDAL_S3_SECRET_ACCESS_KEY
However, I noticed that these variables are not specified in the docker-compose.yaml file and must be manually added to ensure proper functionality.

For reference, I found a related configuration in the OpenDAL GitHub repository:

docker-compose-minio.yml
I recommend updating the documentation to include instructions for adding these environment variables to the docker-compose.yaml file. This addition would streamline the setup process and help prevent potential configuration issues for other users.

Thank you for your attention to this matter.

✔️ Expected Behavior

No response

Actual Behavior

No response

Originally created by @lukefan on GitHub (Dec 29, 2024). ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.14.2 ### Cloud or Self Hosted Self Hosted (Docker) ### Steps to reproduce I am currently working with OpenDAL version 0.14.2 and have encountered an issue regarding the S3 configuration. After setting the storage type to S3 in the .env file, I understand that the following environment variables need to be configured: OPENDAL_S3_ENDPOINT OPENDAL_S3_REGION OPENDAL_S3_BUCKET OPENDAL_S3_ACCESS_KEY_ID OPENDAL_S3_SECRET_ACCESS_KEY However, I noticed that these variables are not specified in the docker-compose.yaml file and must be manually added to ensure proper functionality. For reference, I found a related configuration in the OpenDAL GitHub repository: [docker-compose-minio.yml](https://github.com/apache/opendal/blob/main/fixtures/s3/docker-compose-minio.yml) I recommend updating the documentation to include instructions for adding these environment variables to the docker-compose.yaml file. This addition would streamline the setup process and help prevent potential configuration issues for other users. Thank you for your attention to this matter. ### ✔️ Expected Behavior _No response_ ### ❌ Actual Behavior _No response_
yindo added the 📚 documentationstale labels 2026-02-21 18:20:35 -05:00
yindo closed this issue 2026-02-21 18:20:35 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Dec 29, 2024):

To configure the necessary S3 environment variables in the docker-compose.yaml file for OpenDAL version 0.14.2, you should manually add the following variables to ensure proper functionality:

version: '3.8'
services:
  your_service_name:
    environment:
      OPENDAL_S3_ACCESS_KEY_ID: your_access_key_id
      OPENDAL_S3_SECRET_ACCESS_KEY: your_secret_access_key
      OPENDAL_S3_BUCKET: your_bucket_name
      OPENDAL_S3_REGION: your_region
      OPENDAL_S3_ENDPOINT: your_endpoint

Replace your_service_name with the actual name of your service and fill in the placeholders (your_access_key_id, your_secret_access_key, etc.) with your specific S3 configuration details. This setup should help streamline the configuration process and prevent potential issues [1].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other

@dosubot[bot] commented on GitHub (Dec 29, 2024): <!-- Answer --> To configure the necessary S3 environment variables in the `docker-compose.yaml` file for OpenDAL version 0.14.2, you should manually add the following variables to ensure proper functionality: ```yaml version: '3.8' services: your_service_name: environment: OPENDAL_S3_ACCESS_KEY_ID: your_access_key_id OPENDAL_S3_SECRET_ACCESS_KEY: your_secret_access_key OPENDAL_S3_BUCKET: your_bucket_name OPENDAL_S3_REGION: your_region OPENDAL_S3_ENDPOINT: your_endpoint ``` Replace `your_service_name` with the actual name of your service and fill in the placeholders (`your_access_key_id`, `your_secret_access_key`, etc.) with your specific S3 configuration details. This setup should help streamline the configuration process and prevent potential issues <sup>[[1]](https://github.com/langgenius/dify/blob/main/dev/pytest/pytest_config_tests.py)</sup>. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.* --- <sup>Help Dosu learn! Give it feedback: [Great Response](https://app.dosu.dev/response-feedback/308e2449-242d-4531-b2d8-9b3598c949f3?feedback_type=great_response) | [Irrelevant Answer](https://app.dosu.dev/response-feedback/308e2449-242d-4531-b2d8-9b3598c949f3?feedback_type=irrelevant_answer) | [Incorrect Sources](https://app.dosu.dev/response-feedback/308e2449-242d-4531-b2d8-9b3598c949f3?feedback_type=incorrect_sources) | [Too Verbose](https://app.dosu.dev/response-feedback/308e2449-242d-4531-b2d8-9b3598c949f3?feedback_type=too_verbose) | [Hallucination](https://app.dosu.dev/response-feedback/308e2449-242d-4531-b2d8-9b3598c949f3?feedback_type=hallucination) | [Other](https://app.dosu.dev/response-feedback/308e2449-242d-4531-b2d8-9b3598c949f3?feedback_type=other)</sup>
Author
Owner

@laipz8200 commented on GitHub (Dec 30, 2024):

We didn't list them because OpenDAL has too many optional configurations. If you set them in the .env file, it can work with Docker Compose, so there's no need to add them in the docker-compose.yaml.

@laipz8200 commented on GitHub (Dec 30, 2024): We didn't list them because OpenDAL has too many optional configurations. If you set them in the .env file, it can work with Docker Compose, so there's no need to add them in the docker-compose.yaml.
Author
Owner

@dosubot[bot] commented on GitHub (Jan 31, 2025):

Hi, @lukefan. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary

  • Lack of documentation for configuring S3 storage in OpenDAL 0.14.2 using Docker Compose.
  • You highlighted the need to manually add environment variables in docker-compose.yaml.
  • I provided an example for adding these variables.
  • laipz8200 suggested using a .env file for configuration without modifying docker-compose.yaml.

Next Steps

  • Please confirm if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If no further input is provided, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

@dosubot[bot] commented on GitHub (Jan 31, 2025): Hi, @lukefan. I'm [Dosu](https://dosu.dev), and I'm helping the Dify team manage their backlog. I'm marking this issue as stale. **Issue Summary** - Lack of documentation for configuring S3 storage in OpenDAL 0.14.2 using Docker Compose. - You highlighted the need to manually add environment variables in `docker-compose.yaml`. - I provided an example for adding these variables. - laipz8200 suggested using a `.env` file for configuration without modifying `docker-compose.yaml`. **Next Steps** - Please confirm if this issue is still relevant to the latest version of the Dify repository by commenting here. - If no further input is provided, the issue will be automatically closed in 15 days. Thank you for your understanding and contribution!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#7438