When I manually compile the interface service using the API, the following error occurs.. #5785

Closed
opened 2026-02-21 18:12:35 -05:00 by yindo · 4 comments
Owner

Originally created by @kyomic on GitHub (Sep 24, 2024).

Self Checks

  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

0.8.3

Cloud or Self Hosted

Self Hosted (Source)

Steps to reproduce

ENV:

Darwin 192.168.1.7 19.6.0 Darwin Kernel Version 19.6.0: Tue Jun 21 21:18:39 PDT 2022; root:xnu-6153.141.66~1/RELEASE_X86_64 x86_64

MacOS 10.15.7, intel cpu

$ cd api
$ poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
Fatal Python error: Segmentation fault

Current thread 0x000000010c487dc0 (most recent call first):
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 1176 in create_module
  File "<frozen importlib._bootstrap>", line 571 in module_from_spec
  File "<frozen importlib._bootstrap>", line 674 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pyarrow/__init__.py", line 65 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pandas/compat/pyarrow.py", line 8 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pandas/compat/__init__.py", line 27 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pandas/__init__.py", line 26 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/table.py", line 28 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/job/copy_.py", line 22 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/job/__init__.py", line 27 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1078 in _handle_fromlist
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/_job_helpers.py", line 47 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1078 in _handle_fromlist
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/client.py", line 69 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/__init__.py", line 35 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1078 in _handle_fromlist
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/aiplatform/datasets/column_names_dataset.py", line 24 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/aiplatform/datasets/__init__.py", line 19 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/aiplatform/__init__.py", line 26 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/vertexai/__init__.py", line 17 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 883 in exec_module
  File "<frozen importlib._bootstrap>", line 688 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 992 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/Users/wangxk/git/dify/api/core/model_runtime/model_providers/vertex_ai/llm/llm.py", line 9 in <module>
  ...

Extension modules: markupsafe._speedups, greenlet._greenlet, zope.interface._zope_interface_coptimizations, gevent.libev.corecext, gevent._gevent_c_greenlet_primitives, gevent._gevent_c_hub_local, gevent._gevent_c_waiter, gevent._gevent_c_hub_primitives, gevent._gevent_c_ident, gevent._gevent_cgreenlet, gevent._gevent_c_abstract_linkable, gevent._gevent_c_semaphore, gevent._gevent_clocal, gevent._gevent_cevent, gevent._gevent_cqueue, grpc._cython.cygrpc, gevent._gevent_c_imap, yaml._yaml, sqlalchemy.cyextension.collections, sqlalchemy.cyextension.immutabledict, sqlalchemy.cyextension.processors, sqlalchemy.cyextension.resultproxy, sqlalchemy.cyextension.util, _cffi_backend, hiredis.hiredis, crcmod._crcfunext, _brotli, zstandard.backend_c, charset_normalizer.md, multidict._multidict, yarl._helpers_c, yarl._quoting_c, aiohttp._helpers, aiohttp._http_writer, aiohttp._http_parser, aiohttp._websocket, frozenlist._frozenlist, google._upb._message, gmpy2.gmpy2, numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._fft, torch._C._linalg, torch._C._nn, torch._C._sparse, torch._C._special, regex._regex, PIL._imaging (total: 60)
Segmentation fault: 11

✔️ Expected Behavior

The Docker-related containers are running normally.

Actual Behavior

some LLM error!

Originally created by @kyomic on GitHub (Sep 24, 2024). ### Self Checks - [X] This is only for bug report, if you would like to ask a question, please head to [Discussions](https://github.com/langgenius/dify/discussions/categories/general). - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### Dify version 0.8.3 ### Cloud or Self Hosted Self Hosted (Source) ### Steps to reproduce # ENV: Darwin 192.168.1.7 19.6.0 Darwin Kernel Version 19.6.0: Tue Jun 21 21:18:39 PDT 2022; root:xnu-6153.141.66~1/RELEASE_X86_64 x86_64 MacOS 10.15.7, intel cpu ``` $ cd api $ poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug Fatal Python error: Segmentation fault Current thread 0x000000010c487dc0 (most recent call first): File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 1176 in create_module File "<frozen importlib._bootstrap>", line 571 in module_from_spec File "<frozen importlib._bootstrap>", line 674 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pyarrow/__init__.py", line 65 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pandas/compat/pyarrow.py", line 8 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pandas/compat/__init__.py", line 27 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pandas/__init__.py", line 26 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/table.py", line 28 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/job/copy_.py", line 22 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/job/__init__.py", line 27 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 1078 in _handle_fromlist File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/_job_helpers.py", line 47 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 1078 in _handle_fromlist File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/client.py", line 69 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/bigquery/__init__.py", line 35 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 1078 in _handle_fromlist File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/aiplatform/datasets/column_names_dataset.py", line 24 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/aiplatform/datasets/__init__.py", line 19 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/google/cloud/aiplatform/__init__.py", line 26 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/vertexai/__init__.py", line 17 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 883 in exec_module File "<frozen importlib._bootstrap>", line 688 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 992 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/Users/wangxk/git/dify/api/core/model_runtime/model_providers/vertex_ai/llm/llm.py", line 9 in <module> ... Extension modules: markupsafe._speedups, greenlet._greenlet, zope.interface._zope_interface_coptimizations, gevent.libev.corecext, gevent._gevent_c_greenlet_primitives, gevent._gevent_c_hub_local, gevent._gevent_c_waiter, gevent._gevent_c_hub_primitives, gevent._gevent_c_ident, gevent._gevent_cgreenlet, gevent._gevent_c_abstract_linkable, gevent._gevent_c_semaphore, gevent._gevent_clocal, gevent._gevent_cevent, gevent._gevent_cqueue, grpc._cython.cygrpc, gevent._gevent_c_imap, yaml._yaml, sqlalchemy.cyextension.collections, sqlalchemy.cyextension.immutabledict, sqlalchemy.cyextension.processors, sqlalchemy.cyextension.resultproxy, sqlalchemy.cyextension.util, _cffi_backend, hiredis.hiredis, crcmod._crcfunext, _brotli, zstandard.backend_c, charset_normalizer.md, multidict._multidict, yarl._helpers_c, yarl._quoting_c, aiohttp._helpers, aiohttp._http_writer, aiohttp._http_parser, aiohttp._websocket, frozenlist._frozenlist, google._upb._message, gmpy2.gmpy2, numpy.core._multiarray_umath, numpy.core._multiarray_tests, numpy.linalg._umath_linalg, numpy.fft._pocketfft_internal, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, torch._C, torch._C._fft, torch._C._linalg, torch._C._nn, torch._C._sparse, torch._C._special, regex._regex, PIL._imaging (total: 60) Segmentation fault: 11 ``` ### ✔️ Expected Behavior The Docker-related containers are running normally. ### ❌ Actual Behavior some LLM error!
yindo added the 🐞 bug🤔 cant-reproduce labels 2026-02-21 18:12:35 -05:00
yindo closed this issue 2026-02-21 18:12:35 -05:00
Author
Owner

@dosubot[bot] commented on GitHub (Sep 24, 2024):

Hello @kyomic! I'm here to assist you with any bugs, questions, or contributions. Let's work together to resolve any issues you encounter.

The segmentation fault you're encountering when running the Dify API on MacOS 10.15.7 with an Intel CPU seems to be related to the pyarrow library. This is a known issue with pyarrow on certain MacOS versions and hardware configurations.

Here are a few steps you can try to resolve this issue:

  1. Update pyarrow and Dependencies:
    Ensure that you have the latest version of pyarrow and its dependencies. You can update pyarrow using poetry:

    poetry add pyarrow --upgrade
    
  2. Reinstall pyarrow:
    Sometimes, simply reinstalling the library can resolve the issue:

    poetry remove pyarrow
    poetry add pyarrow
    
  3. Use a Different Python Version:
    There might be compatibility issues with the specific Python version you are using. Try using a different Python version (e.g., Python 3.9):

    poetry env use 3.9
    poetry install
    
  4. Check for MacOS Updates:
    Ensure that your MacOS is up to date. Sometimes, system updates can resolve compatibility issues.

  5. Use a Virtual Environment:
    If you are not already using a virtual environment, consider setting one up to isolate dependencies:

    python -m venv venv
    source venv/bin/activate
    poetry install
    
  6. Run with Docker:
    If the issue persists, consider running the Dify API within a Docker container to avoid host system compatibility issues. The Dify documentation provides steps to start the Docker stack:

    cd ../docker
    cp middleware.env.example middleware.env
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
    

If none of these steps resolve the issue, you might need to look into more specific compatibility problems between pyarrow and MacOS 10.15.7 with an Intel CPU, or consider reaching out to the pyarrow community for further assistance.

To continue talking to Dosu, mention @dosu.

@dosubot[bot] commented on GitHub (Sep 24, 2024): <!-- Greeting --> Hello @kyomic! I'm here to assist you with any bugs, questions, or contributions. Let's work together to resolve any issues you encounter. <!-- Answer --> The segmentation fault you're encountering when running the Dify API on MacOS 10.15.7 with an Intel CPU seems to be related to the `pyarrow` library. This is a known issue with `pyarrow` on certain MacOS versions and hardware configurations. Here are a few steps you can try to resolve this issue: 1. **Update `pyarrow` and Dependencies**: Ensure that you have the latest version of `pyarrow` and its dependencies. You can update `pyarrow` using `poetry`: ```bash poetry add pyarrow --upgrade ``` 2. **Reinstall `pyarrow`**: Sometimes, simply reinstalling the library can resolve the issue: ```bash poetry remove pyarrow poetry add pyarrow ``` 3. **Use a Different Python Version**: There might be compatibility issues with the specific Python version you are using. Try using a different Python version (e.g., Python 3.9): ```bash poetry env use 3.9 poetry install ``` 4. **Check for MacOS Updates**: Ensure that your MacOS is up to date. Sometimes, system updates can resolve compatibility issues. 5. **Use a Virtual Environment**: If you are not already using a virtual environment, consider setting one up to isolate dependencies: ```bash python -m venv venv source venv/bin/activate poetry install ``` 6. **Run with Docker**: If the issue persists, consider running the Dify API within a Docker container to avoid host system compatibility issues. The Dify documentation provides steps to start the Docker stack: ```bash cd ../docker cp middleware.env.example middleware.env docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d cd ../api poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug ``` If none of these steps resolve the issue, you might need to look into more specific compatibility problems between `pyarrow` and MacOS 10.15.7 with an Intel CPU, or consider reaching out to the `pyarrow` community for further assistance. <!-- Dosu Comment Footer --> *To continue talking to [Dosu](https://dosu.dev), mention @dosu.*
Author
Owner

@crazywoola commented on GitHub (Sep 25, 2024):

This is not related to the dify itself. If you choose to use the source code to start the application, we assume you have the basic knowledge of how to install dependancies.

@crazywoola commented on GitHub (Sep 25, 2024): This is not related to the dify itself. If you choose to use the source code to start the application, we assume you have the basic knowledge of how to install dependancies.
Author
Owner

@kyomic commented on GitHub (Sep 27, 2024):

On my Mac, when I start the API service, I get the following error:

Segmentation fault: 11

Then I added some debugging code in app.py, and the above error was raised.

import faulthandler
faulthandler.enable()

Report the above error.It seems like a circular import in Python or a Python version issue error.

Current thread 0x000000010c487dc0 (most recent call first):
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
  File "<frozen importlib._bootstrap_external>", line 1176 in create_module
  File "<frozen importlib._bootstrap>", line 571 in module_from_spec
  File "<frozen importlib._bootstrap>", line 674 in _load_unlocked
  File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 1027 in _find_and_load
  File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pyarrow/__init__.py", line 65 in <module>
  File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed
...

I believe I know how to install package dependencies correctly. I compiled the Dockerfile and was able to start the API service, as shown below:

None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration, and file/data utilities can be used.
sagemaker.config INFO - Not applying SDK defaults from location: /etc/xdg/sagemaker/config.yaml
sagemaker.config INFO - Not applying SDK defaults from location: /root/.config/sagemaker/config.yaml
2024-09-27 06:19:43,804.804 WARNING [MainThread] [ext_mail.py:51] - MAIL_TYPE is not set
[2024-09-27 06:19:45 +0000] [1] [INFO] Starting gunicorn 22.0.0
[2024-09-27 06:19:45 +0000] [1] [INFO] Listening at: http://0.0.0.0:5001 (1)
[2024-09-27 06:19:45 +0000] [1] [INFO] Using worker: gevent
[2024-09-27 06:19:45 +0000] [22] [INFO] Booting worker with pid: 22
[2024-09-27 06:22:02 +0000] [1] [INFO] Handling signal: term
[2024-09-27 06:22:03 +0000] [22] [INFO] Worker exiting (pid: 22)
[2024-09-27 06:22:06 +0000] [1] [ERROR] Worker (pid:21) exited with code 1
[2024-09-27 06:22:06 +0000] [1] [ERROR] Worker (pid:21) exited with code 1.
[2024-09-27 06:22:06 +0000] [1] [INFO] Shutting down: Master

Has anyone else successfully run this project on an older Mac with version 10.15?

Let me know if any part needs to be further modified!

@kyomic commented on GitHub (Sep 27, 2024): On my Mac, when I start the API service, I get the following error: ``` Segmentation fault: 11 ``` Then I added some debugging code in app.py, and the above error was raised. ```python import faulthandler faulthandler.enable() ``` Report the above error.It seems like a circular import in Python or a Python version issue error. ```python Current thread 0x000000010c487dc0 (most recent call first): File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed File "<frozen importlib._bootstrap_external>", line 1176 in create_module File "<frozen importlib._bootstrap>", line 571 in module_from_spec File "<frozen importlib._bootstrap>", line 674 in _load_unlocked File "<frozen importlib._bootstrap>", line 1006 in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 1027 in _find_and_load File "/opt/miniconda3/envs/py310/lib/python3.10/site-packages/pyarrow/__init__.py", line 65 in <module> File "<frozen importlib._bootstrap>", line 241 in _call_with_frames_removed ... ``` I believe I know how to install package dependencies correctly. I compiled the Dockerfile and was able to start the API service, as shown below: ```python None of PyTorch, TensorFlow >= 2.0, or Flax have been found. Models won't be available and only tokenizers, configuration, and file/data utilities can be used. sagemaker.config INFO - Not applying SDK defaults from location: /etc/xdg/sagemaker/config.yaml sagemaker.config INFO - Not applying SDK defaults from location: /root/.config/sagemaker/config.yaml 2024-09-27 06:19:43,804.804 WARNING [MainThread] [ext_mail.py:51] - MAIL_TYPE is not set [2024-09-27 06:19:45 +0000] [1] [INFO] Starting gunicorn 22.0.0 [2024-09-27 06:19:45 +0000] [1] [INFO] Listening at: http://0.0.0.0:5001 (1) [2024-09-27 06:19:45 +0000] [1] [INFO] Using worker: gevent [2024-09-27 06:19:45 +0000] [22] [INFO] Booting worker with pid: 22 [2024-09-27 06:22:02 +0000] [1] [INFO] Handling signal: term [2024-09-27 06:22:03 +0000] [22] [INFO] Worker exiting (pid: 22) [2024-09-27 06:22:06 +0000] [1] [ERROR] Worker (pid:21) exited with code 1 [2024-09-27 06:22:06 +0000] [1] [ERROR] Worker (pid:21) exited with code 1. [2024-09-27 06:22:06 +0000] [1] [INFO] Shutting down: Master ``` Has anyone else successfully run this project on an older Mac with version 10.15? Let me know if any part needs to be further modified!
Author
Owner

@kyomic commented on GitHub (Oct 18, 2024):

Thank you, Google! I have found the solution: downgrading pyarrow to version 15.0.2 should work, as the current version 17.0.0 has unknown compatibility issues. You can do this by running:

pip uninstall pyarrow
pip install pyarrow==15.0.2

@kyomic commented on GitHub (Oct 18, 2024): Thank you, Google! I have found the solution: downgrading pyarrow to version 15.0.2 should work, as the current version 17.0.0 has unknown compatibility issues. You can do this by running: ``` pip uninstall pyarrow pip install pyarrow==15.0.2 ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#5785