Using Phi3 with Langgraph, Multi agent framework #230

Closed
opened 2026-02-20 17:32:55 -05:00 by yindo · 2 comments
Owner

Originally created by @hunaidkhan2000 on GitHub (Sep 10, 2024).

Checked other resources

  • I added a very descriptive title to this issue.
  • I searched the LangGraph/LangChain documentation with the integrated search.
  • I used the GitHub search to find a similar question and didn't find it.
  • I am sure that this is a bug in LangGraph/LangChain rather than my code.
  • I am sure this is better as an issue rather than a GitHub discussion, since this is a LangGraph bug and not a design question.

Example Code

Na

Error Message and Stack Trace (if applicable)

No response

Description

Na

System Info

This issue is for a: (mark with an x)

  • [x ] bug report -> please search issues before submitting
  • [] feature request
  • documentation issue or request
  • regression (a behavior that used to work and stopped in a new release)
    Minimal steps to reproduce
    Using Phi 3 with Langgraph

Any log messages given by the failure
NA

Expected/desired behavior
Multi agent framework with routing

OS and Version?
Windows 10

Mention any other details that might be useful
I am trying to use Phi 3 mini 128 instruct with Langgraph for a multi-agent framework where it can route requests accurately. However, Phi 3 is not able to route the queries properly to a specific tool. Can anyone help? Does Phi 3 work with Langgraph, and does it support function calling or tool calling?

Originally created by @hunaidkhan2000 on GitHub (Sep 10, 2024). ### Checked other resources - [X] I added a very descriptive title to this issue. - [X] I searched the [LangGraph](https://langchain-ai.github.io/langgraph/)/LangChain documentation with the integrated search. - [X] I used the GitHub search to find a similar question and didn't find it. - [X] I am sure that this is a bug in LangGraph/LangChain rather than my code. - [X] I am sure this is better as an issue [rather than a GitHub discussion](https://github.com/langchain-ai/langgraph/discussions/new/choose), since this is a LangGraph bug and not a design question. ### Example Code ```python Na ``` ### Error Message and Stack Trace (if applicable) _No response_ ### Description Na ### System Info This issue is for a: (mark with an x) - [x ] bug report -> please search issues before submitting - [] feature request - [ ] documentation issue or request - [ ] regression (a behavior that used to work and stopped in a new release) Minimal steps to reproduce Using Phi 3 with Langgraph Any log messages given by the failure NA Expected/desired behavior Multi agent framework with routing OS and Version? Windows 10 Mention any other details that might be useful I am trying to use Phi 3 mini 128 instruct with Langgraph for a multi-agent framework where it can route requests accurately. However, Phi 3 is not able to route the queries properly to a specific tool. Can anyone help? Does Phi 3 work with Langgraph, and does it support function calling or tool calling?
yindo closed this issue 2026-02-20 17:32:55 -05:00
Author
Owner

@gbaian10 commented on GitHub (Sep 10, 2024):

If you use Ollama, you can first check https://ollama.com/blog/tool-support to see if the model supports tool_call.
If it doesn't, it won't function properly.

@gbaian10 commented on GitHub (Sep 10, 2024): If you use Ollama, you can first check <https://ollama.com/blog/tool-support> to see if the model supports tool_call. If it doesn't, it won't function properly.
Author
Owner

@vbarda commented on GitHub (Sep 10, 2024):

Turning this into a discussion, as it's not an issue with langgraph

@vbarda commented on GitHub (Sep 10, 2024): Turning this into a discussion, as it's not an issue with langgraph
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langgraph#230