Can the conversational application API add a model_config parameter? #5853

Closed
opened 2026-02-21 18:12:53 -05:00 by yindo · 2 comments
Owner

Originally created by @andylzming on GitHub (Sep 28, 2024).

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

model_config :{
    "pre_prompt": "假设你叫“智能助手”,你有以下技能:\n- 会聊天\n- 会讲故事\n- 会思考\n- 会讲笑话",
    "prompt_type": "simple",
    "chat_prompt_config": {},
    "completion_prompt_config": {},
    "user_input_form": [],
    "dataset_query_variable": "",
    "opening_statement": "",
    "more_like_this": {
        "enabled": false
    },
    "suggested_questions": [],
    "suggested_questions_after_answer": {
        "enabled": false
    },
    "text_to_speech": {
        "enabled": false,
        "voice": "",
        "language": ""
    },
    "speech_to_text": {
        "enabled": false
    },
    "retriever_resource": {
        "enabled": false
    },
    "sensitive_word_avoidance": {
        "canned_response": "",
        "enabled": false,
        "words": ""
    },
    "agent_mode": {
        "enabled": false,
        "max_iteration": 5,
        "strategy": "function_call",
        "tools": []
    },
    "dataset_configs": {
        "retrieval_model": "single",
        "datasets": {
            "datasets": []
        }
    },
    "file_upload": {
        "image": {
            "enabled": false,
            "number_limits": 3,
            "detail": "high",
            "transfer_methods": [
                "remote_url",
                "local_file"
            ]
        }
    },
    "annotation_reply": {
        "id": "1b09c7dc-9dd2-4681-80ea-b03d3dc940e6",
        "enabled": true,
        "score_threshold": 0.8,
        "embedding_model": {
            "embedding_provider_name": "xinference",
            "embedding_model_name": "custom-text2vec-large-chinese"
        }
    },
    "supportAnnotation": true,
    "appId": "2cddb66d-cf78-4d44-86a3-a2963c2acb10",
    "supportCitationHitInfo": true,
    "model": {
        "provider": "xinference",
        "name": "custom-qwen-chat",
        "mode": "chat",
        "completion_params": {
            "stop": []
        }
    }
}

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
Originally created by @andylzming on GitHub (Sep 28, 2024). ### Self Checks - [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones. - [X] I confirm that I am using English to submit this report (我已阅读并同意 [Language Policy](https://github.com/langgenius/dify/issues/1542)). - [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:) - [X] Please do not modify this template :) and fill in all the required fields. ### 1. Is this request related to a challenge you're experiencing? Tell me about your story. - Can the "http://127.0.0.1/v1" interface add a model_config parameter? ``` model_config :{ "pre_prompt": "假设你叫“智能助手”,你有以下技能:\n- 会聊天\n- 会讲故事\n- 会思考\n- 会讲笑话", "prompt_type": "simple", "chat_prompt_config": {}, "completion_prompt_config": {}, "user_input_form": [], "dataset_query_variable": "", "opening_statement": "", "more_like_this": { "enabled": false }, "suggested_questions": [], "suggested_questions_after_answer": { "enabled": false }, "text_to_speech": { "enabled": false, "voice": "", "language": "" }, "speech_to_text": { "enabled": false }, "retriever_resource": { "enabled": false }, "sensitive_word_avoidance": { "canned_response": "", "enabled": false, "words": "" }, "agent_mode": { "enabled": false, "max_iteration": 5, "strategy": "function_call", "tools": [] }, "dataset_configs": { "retrieval_model": "single", "datasets": { "datasets": [] } }, "file_upload": { "image": { "enabled": false, "number_limits": 3, "detail": "high", "transfer_methods": [ "remote_url", "local_file" ] } }, "annotation_reply": { "id": "1b09c7dc-9dd2-4681-80ea-b03d3dc940e6", "enabled": true, "score_threshold": 0.8, "embedding_model": { "embedding_provider_name": "xinference", "embedding_model_name": "custom-text2vec-large-chinese" } }, "supportAnnotation": true, "appId": "2cddb66d-cf78-4d44-86a3-a2963c2acb10", "supportCitationHitInfo": true, "model": { "provider": "xinference", "name": "custom-qwen-chat", "mode": "chat", "completion_params": { "stop": [] } } } ``` ### 2. Additional context or comments _No response_ ### 3. Can you help us with this feature? - [X] I am interested in contributing to this feature.
yindo added the 💪 enhancement label 2026-02-21 18:12:53 -05:00
yindo closed this issue 2026-02-21 18:12:53 -05:00
Author
Owner

@andylzming commented on GitHub (Sep 28, 2024):

The current situation is that the provided pre_prompt and model parameters are not taking effect. There is a suspicion that the conversational application API does not support the model_config parameter.

@andylzming commented on GitHub (Sep 28, 2024): The current situation is that the provided pre_prompt and model parameters are not taking effect. There is a suspicion that the conversational application API does not support the model_config parameter.
Author
Owner

@crazywoola commented on GitHub (Sep 29, 2024):

Sorry we don’t have a plan for this

@crazywoola commented on GitHub (Sep 29, 2024): Sorry we don’t have a plan for this
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langgenius/dify#5853