configurable init chat model not accepting structured response #959

Closed
opened 2026-02-20 17:42:32 -05:00 by yindo · 2 comments
Owner

Originally created by @umashankar0705 on GitHub (Sep 2, 2025).

Checked other resources

  • This is a bug, not a usage question. For questions, please use the LangChain Forum (https://forum.langchain.com/).
  • I added a clear and detailed title that summarizes the issue.
  • I read what a minimal reproducible example is (https://stackoverflow.com/help/minimal-reproducible-example).
  • I included a self-contained, minimal example that demonstrates the issue INCLUDING all the relevant imports. The code run AS IS to reproduce the issue.

Example Code

config = {
            "model": os.getenv("AZURE_OPENAI_MODEL"),
            "temperature": os.getenv("TEMPERATURE"),
            "model_provider": os.getenv("MODEL_PROVIDER"),
            "azure_endpoint": os.getenv("AZURE_OPENAI_API_URL"),
            "api_key": os.getenv("AZURE_OPENAI_API_KEY"),
            "api_version": os.getenv("AZURE_OPENAI_API_VERSION"),
            "configurable_fields": "Any",
            "config_prefix": f"Test_",
        }
        
config.update(kwargs)        
model = init_chat_model(**config)

create_react_agent(
            model=model, 
            tools=resolved_tools, 
            response_format=structured_response,
            name=name
        )

Error Message and Stack Trace (if applicable)

TypeError: Expected `model` to be a ChatModel or RunnableBinding (e.g. model.bind_tools(...)), got <class 'langchain_core.runnables.base.RunnableSequence'>
During task with name 'generate_structured_response' and id '15f40a9e-bc88-6ec7-9f67-7c5cc499d91c'

Description

The structured response for init chat model when configurable doesnt work

System Info

System Information

OS: Windows
OS Version: 10.0.17763
Python Version: 3.11.11 (main, Jan 5 2025, 05:35:58) [MSC v.1942 64 bit (AMD64)]

Package Information

langchain_core: 0.3.75
langchain: 0.3.27
langchain_community: 0.3.29
langsmith: 0.4.21
langchain_anthropic: 0.3.19
langchain_azure_ai: 0.1.4
langchain_chroma: 0.2.5
langchain_experimental: 0.3.4
langchain_huggingface: 0.3.1
langchain_openai: 0.3.32
langchain_sqlserver: 0.1.2
langchain_text_splitters: 0.3.11
langgraph_sdk: 0.2.4
langgraph_supervisor: 0.0.29

Optional packages not installed

langserve

Other Dependencies

aiohttp: 3.12.15
aiohttp<4.0.0,>=3.8.3: Installed. No version info available.
anthropic<1,>=0.64.0: Installed. No version info available.
async-timeout<5.0.0,>=4.0.0;: Installed. No version info available.
azure-ai-inference[opentelemetry]: Installed. No version info available.
azure-core: 1.35.0
azure-cosmos: 4.9.0
azure-identity: 1.24.0
azure-monitor-opentelemetry: Installed. No version info available.
chromadb>=1.0.9: Installed. No version info available.
dataclasses-json<0.7,>=0.6.7: Installed. No version info available.
httpx-sse<1.0.0,>=0.4.0: Installed. No version info available.
httpx<1,>=0.23.0: Installed. No version info available.
httpx>=0.25.2: Installed. No version info available.
huggingface-hub>=0.33.4: Installed. No version info available.
jsonpatch<2.0,>=1.33: Installed. No version info available.
langchain-anthropic;: Installed. No version info available.
langchain-aws;: Installed. No version info available.
langchain-azure-ai;: Installed. No version info available.
langchain-cohere;: Installed. No version info available.
langchain-community;: Installed. No version info available.
langchain-core<1.0.0,>=0.3.70: Installed. No version info available.
langchain-core<1.0.0,>=0.3.72: Installed. No version info available.
langchain-core<1.0.0,>=0.3.74: Installed. No version info available.
langchain-core<2.0.0,>=0.3.75: Installed. No version info available.
langchain-core>=0.3.40: Installed. No version info available.
langchain-core>=0.3.70: Installed. No version info available.
langchain-deepseek;: Installed. No version info available.
langchain-fireworks;: Installed. No version info available.
langchain-google-genai;: Installed. No version info available.
langchain-google-vertexai;: Installed. No version info available.
langchain-groq;: Installed. No version info available.
langchain-huggingface;: Installed. No version info available.
langchain-mistralai;: Installed. No version info available.
langchain-ollama;: Installed. No version info available.
langchain-openai;: Installed. No version info available.
langchain-perplexity;: Installed. No version info available.
langchain-text-splitters<1.0.0,>=0.3.9: Installed. No version info available.
langchain-together;: Installed. No version info available.
langchain-xai;: Installed. No version info available.
langchain<2.0.0,>=0.3.27: Installed. No version info available.
langgraph<0.7.0,>=0.6.0: Installed. No version info available.
langsmith-pyo3>=0.1.0rc2;: Installed. No version info available.
langsmith>=0.1.125: Installed. No version info available.
langsmith>=0.1.17: Installed. No version info available.
langsmith>=0.3.45: Installed. No version info available.
numpy: 1.26.4
numpy>=1.26.0;: Installed. No version info available.
numpy>=1.26.2;: Installed. No version info available.
numpy>=2.1.0;: Installed. No version info available.
openai-agents>=0.0.3;: Installed. No version info available.
openai<2.0.0,>=1.99.9: Installed. No version info available.
opentelemetry-api>=1.30.0;: Installed. No version info available.
opentelemetry-exporter-otlp-proto-http>=1.30.0;: Installed. No version info available.
opentelemetry-instrumentation-threading: Installed. No version info available.
opentelemetry-sdk>=1.30.0;: Installed. No version info available.
opentelemetry-semantic-conventions-ai: Installed. No version info available.
orjson>=3.10.1: Installed. No version info available.
orjson>=3.9.14;: Installed. No version info available.
packaging>=23.2: Installed. No version info available.
pydantic-settings<3.0.0,>=2.10.1: Installed. No version info available.
pydantic<3,>=1: Installed. No version info available.
pydantic<3.0.0,>=2.7.4: Installed. No version info available.
pydantic>=2.7.4: Installed. No version info available.
pyodbc: 5.2.0
pytest>=7.0.0;: Installed. No version info available.
PyYAML>=5.3: Installed. No version info available.
requests-toolbelt>=1.0.0: Installed. No version info available.
requests<3,>=2: Installed. No version info available.
requests<3,>=2.32.5: Installed. No version info available.
requests>=2.0.0: Installed. No version info available.
rich>=13.9.4;: Installed. No version info available.
sentence-transformers>=2.6.0;: Installed. No version info available.
SQLAlchemy: 2.0.43
SQLAlchemy<3,>=1.4: Installed. No version info available.
tenacity!=8.4.0,<10,>=8.1.0: Installed. No version info available.
tenacity!=8.4.0,<10.0.0,>=8.1.0: Installed. No version info available.
tiktoken<1,>=0.7: Installed. No version info available.
tokenizers>=0.19.1: Installed. No version info available.
transformers>=4.39.0;: Installed. No version info available.
typing-extensions>=4.7: Installed. No version info available.
vcrpy>=7.0.0;: Installed. No version info available.
zstandard>=0.23.0: Installed. No version info available.

Originally created by @umashankar0705 on GitHub (Sep 2, 2025). ### Checked other resources - [x] This is a bug, not a usage question. For questions, please use the LangChain Forum (https://forum.langchain.com/). - [x] I added a clear and detailed title that summarizes the issue. - [x] I read what a minimal reproducible example is (https://stackoverflow.com/help/minimal-reproducible-example). - [x] I included a self-contained, minimal example that demonstrates the issue INCLUDING all the relevant imports. The code run AS IS to reproduce the issue. ### Example Code ```python config = { "model": os.getenv("AZURE_OPENAI_MODEL"), "temperature": os.getenv("TEMPERATURE"), "model_provider": os.getenv("MODEL_PROVIDER"), "azure_endpoint": os.getenv("AZURE_OPENAI_API_URL"), "api_key": os.getenv("AZURE_OPENAI_API_KEY"), "api_version": os.getenv("AZURE_OPENAI_API_VERSION"), "configurable_fields": "Any", "config_prefix": f"Test_", } config.update(kwargs) model = init_chat_model(**config) create_react_agent( model=model, tools=resolved_tools, response_format=structured_response, name=name ) ``` ### Error Message and Stack Trace (if applicable) ```shell TypeError: Expected `model` to be a ChatModel or RunnableBinding (e.g. model.bind_tools(...)), got <class 'langchain_core.runnables.base.RunnableSequence'> During task with name 'generate_structured_response' and id '15f40a9e-bc88-6ec7-9f67-7c5cc499d91c' ``` ### Description The structured response for init chat model when configurable doesnt work ### System Info System Information ------------------ > OS: Windows > OS Version: 10.0.17763 > Python Version: 3.11.11 (main, Jan 5 2025, 05:35:58) [MSC v.1942 64 bit (AMD64)] Package Information ------------------- > langchain_core: 0.3.75 > langchain: 0.3.27 > langchain_community: 0.3.29 > langsmith: 0.4.21 > langchain_anthropic: 0.3.19 > langchain_azure_ai: 0.1.4 > langchain_chroma: 0.2.5 > langchain_experimental: 0.3.4 > langchain_huggingface: 0.3.1 > langchain_openai: 0.3.32 > langchain_sqlserver: 0.1.2 > langchain_text_splitters: 0.3.11 > langgraph_sdk: 0.2.4 > langgraph_supervisor: 0.0.29 Optional packages not installed ------------------------------- > langserve Other Dependencies ------------------ > aiohttp: 3.12.15 > aiohttp<4.0.0,>=3.8.3: Installed. No version info available. > anthropic<1,>=0.64.0: Installed. No version info available. > async-timeout<5.0.0,>=4.0.0;: Installed. No version info available. > azure-ai-inference[opentelemetry]: Installed. No version info available. > azure-core: 1.35.0 > azure-cosmos: 4.9.0 > azure-identity: 1.24.0 > azure-monitor-opentelemetry: Installed. No version info available. > chromadb>=1.0.9: Installed. No version info available. > dataclasses-json<0.7,>=0.6.7: Installed. No version info available. > httpx-sse<1.0.0,>=0.4.0: Installed. No version info available. > httpx<1,>=0.23.0: Installed. No version info available. > httpx>=0.25.2: Installed. No version info available. > huggingface-hub>=0.33.4: Installed. No version info available. > jsonpatch<2.0,>=1.33: Installed. No version info available. > langchain-anthropic;: Installed. No version info available. > langchain-aws;: Installed. No version info available. > langchain-azure-ai;: Installed. No version info available. > langchain-cohere;: Installed. No version info available. > langchain-community;: Installed. No version info available. > langchain-core<1.0.0,>=0.3.70: Installed. No version info available. > langchain-core<1.0.0,>=0.3.72: Installed. No version info available. > langchain-core<1.0.0,>=0.3.74: Installed. No version info available. > langchain-core<2.0.0,>=0.3.75: Installed. No version info available. > langchain-core>=0.3.40: Installed. No version info available. > langchain-core>=0.3.70: Installed. No version info available. > langchain-deepseek;: Installed. No version info available. > langchain-fireworks;: Installed. No version info available. > langchain-google-genai;: Installed. No version info available. > langchain-google-vertexai;: Installed. No version info available. > langchain-groq;: Installed. No version info available. > langchain-huggingface;: Installed. No version info available. > langchain-mistralai;: Installed. No version info available. > langchain-ollama;: Installed. No version info available. > langchain-openai;: Installed. No version info available. > langchain-perplexity;: Installed. No version info available. > langchain-text-splitters<1.0.0,>=0.3.9: Installed. No version info available. > langchain-together;: Installed. No version info available. > langchain-xai;: Installed. No version info available. > langchain<2.0.0,>=0.3.27: Installed. No version info available. > langgraph<0.7.0,>=0.6.0: Installed. No version info available. > langsmith-pyo3>=0.1.0rc2;: Installed. No version info available. > langsmith>=0.1.125: Installed. No version info available. > langsmith>=0.1.17: Installed. No version info available. > langsmith>=0.3.45: Installed. No version info available. > numpy: 1.26.4 > numpy>=1.26.0;: Installed. No version info available. > numpy>=1.26.2;: Installed. No version info available. > numpy>=2.1.0;: Installed. No version info available. > openai-agents>=0.0.3;: Installed. No version info available. > openai<2.0.0,>=1.99.9: Installed. No version info available. > opentelemetry-api>=1.30.0;: Installed. No version info available. > opentelemetry-exporter-otlp-proto-http>=1.30.0;: Installed. No version info available. > opentelemetry-instrumentation-threading: Installed. No version info available. > opentelemetry-sdk>=1.30.0;: Installed. No version info available. > opentelemetry-semantic-conventions-ai: Installed. No version info available. > orjson>=3.10.1: Installed. No version info available. > orjson>=3.9.14;: Installed. No version info available. > packaging>=23.2: Installed. No version info available. > pydantic-settings<3.0.0,>=2.10.1: Installed. No version info available. > pydantic<3,>=1: Installed. No version info available. > pydantic<3.0.0,>=2.7.4: Installed. No version info available. > pydantic>=2.7.4: Installed. No version info available. > pyodbc: 5.2.0 > pytest>=7.0.0;: Installed. No version info available. > PyYAML>=5.3: Installed. No version info available. > requests-toolbelt>=1.0.0: Installed. No version info available. > requests<3,>=2: Installed. No version info available. > requests<3,>=2.32.5: Installed. No version info available. > requests>=2.0.0: Installed. No version info available. > rich>=13.9.4;: Installed. No version info available. > sentence-transformers>=2.6.0;: Installed. No version info available. > SQLAlchemy: 2.0.43 > SQLAlchemy<3,>=1.4: Installed. No version info available. > tenacity!=8.4.0,<10,>=8.1.0: Installed. No version info available. > tenacity!=8.4.0,<10.0.0,>=8.1.0: Installed. No version info available. > tiktoken<1,>=0.7: Installed. No version info available. > tokenizers>=0.19.1: Installed. No version info available. > transformers>=4.39.0;: Installed. No version info available. > typing-extensions>=4.7: Installed. No version info available. > vcrpy>=7.0.0;: Installed. No version info available. > zstandard>=0.23.0: Installed. No version info available.
yindo added the bugpending labels 2026-02-20 17:42:32 -05:00
yindo closed this issue 2026-02-20 17:42:32 -05:00
Author
Owner

@harshit-agarwal7 commented on GitHub (Sep 8, 2025):

Hi @umashankar0705

  1. Imports are missing from the above example.
  2. Many of the variables used above are not defined (eg - kwargs, resolved_tools).

Please consider updating your example.

@harshit-agarwal7 commented on GitHub (Sep 8, 2025): Hi @umashankar0705 1. Imports are missing from the above example. 2. Many of the variables used above are not defined (eg - `kwargs`, `resolved_tools`). Please consider updating your example.
Author
Owner

@sydney-runkle commented on GitHub (Sep 8, 2025):

^^ please submit an issue w/ a fully reproducible snippet. We'd be happy to help with an MRE!

@sydney-runkle commented on GitHub (Sep 8, 2025): ^^ please submit an issue w/ a fully reproducible snippet. We'd be happy to help with an [MRE](https://en.wikipedia.org/wiki/Minimal_reproducible_example)!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langgraph#959