langchain-ai/langserve
1
0
Fork 0
mirror of https://github.com/langchain-ai/langserve.git synced 2026-07-18 10:54:29 -04:00
Code Issues 136 Packages Projects Releases 10 Wiki Activity

⚠️ Recommending LangGraph Platform for new projects #239

New Issue
Open
opened 2026-02-16 00:19:43 -05:00 by yindo · 10 comments
yindo commented 2026-02-16 00:19:43 -05:00
Owner
Copy Link
Copy Source

Originally created by @eyurtsev on GitHub (Nov 18, 2024).

We have recently announced LangGraph Platform, a significantly enhanced solution for deploying agentic applications at scale.

We recommend using LangGraph Platform rather than LangServe for new projects.

LangGraph Platform incorporates key design patterns and capabilities essential for production-level deployment of large language model (LLM) applications.

In contrast to LangServe, LangGraph Platform provides comprehensive, out-of-the-box support for persistence, memory, double-texting handling, human-in-the-loop workflows, cron job scheduling, webhooks, high-load management, advanced streaming, support for long-running tasks, background task processing, and much more.

The LangGraph Platform ecosystem includes the following components:

  • LangGraph Server: Provides an Assistants API for LLM applications (graphs) built with LangGraph. Available in both Python and JavaScript/TypeScript.
  • LangGraph Studio: A specialized IDE for real-time visualization, debugging, and interaction via a graphical interface. Available as a web application or macOS desktop app, it's a substantial improvement over LangServe's playground.
  • SDK: Enables programmatic interaction with the server, available in Python and JavaScript/TypeScript.
  • RemoteGraph: Allows interaction with a remote graph as if it were running locally, serving as LangGraph's equivalent to LangServe's RemoteRunnable. Available in both Python and JavaScript/TypeScript.

If you're interested in migrating your LangServe code to LangGraph Platform please the LangGraph Platform Migration Guide for more information.

We will continue to accept bug fixes for LangServe from the community; however, we will not be accepting new feature contributions.

Originally created by @eyurtsev on GitHub (Nov 18, 2024). We have [recently announced](https://blog.langchain.dev/langgraph-platform-announce/) LangGraph Platform, a ***significantly*** enhanced solution for deploying agentic applications at scale. We recommend using LangGraph Platform rather than LangServe for new projects. LangGraph Platform incorporates [key design patterns and capabilities](https://langchain-ai.github.io/langgraph/concepts/langgraph_platform/#option-2-leveraging-langgraph-platform-for-complex-deployments) essential for production-level deployment of large language model (LLM) applications. In contrast to LangServe, LangGraph Platform provides comprehensive, out-of-the-box support for [persistence](https://langchain-ai.github.io/langgraph/concepts/application_structure/), [memory](https://langchain-ai.github.io/langgraph/concepts/assistants/), [double-texting handling](https://langchain-ai.github.io/langgraph/concepts/double_texting/), [human-in-the-loop workflows](https://langchain-ai.github.io/langgraph/concepts/assistants/), [cron job scheduling](https://langchain-ai.github.io/langgraph/concepts/langgraph_server/#cron-jobs), [webhooks](https://langchain-ai.github.io/langgraph/concepts/langgraph_server/#webhooks), high-load management, advanced streaming, support for long-running tasks, background task processing, and much more. The LangGraph Platform ecosystem includes the following components: - [LangGraph Server](https://langchain-ai.github.io/langgraph/concepts/langgraph_server/): Provides an [Assistants API](https://langchain-ai.github.io/langgraph/cloud/reference/api/api_ref.html) for LLM applications (graphs) built with [LangGraph](https://langchain-ai.github.io/langgraph/). Available in both Python and JavaScript/TypeScript. - [LangGraph Studio](https://langchain-ai.github.io/langgraph/concepts/langgraph_studio/): A specialized IDE for real-time visualization, debugging, and interaction via a graphical interface. Available as a web application or macOS desktop app, it's a substantial improvement over LangServe's playground. - [SDK](https://langchain-ai.github.io/langgraph/concepts/sdk/): Enables programmatic interaction with the server, available in Python and JavaScript/TypeScript. - [RemoteGraph](https://langchain-ai.github.io/langgraph/how-tos/use-remote-graph/): Allows interaction with a remote graph as if it were running locally, serving as LangGraph's equivalent to LangServe's RemoteRunnable. Available in both Python and JavaScript/TypeScript. If you're interested in migrating your LangServe code to LangGraph Platform please the [LangGraph Platform Migration Guide](https://github.com/langchain-ai/langserve/blob/main/MIGRATION.md) for more information. We will continue to accept bug fixes for LangServe from the community; however, we will not be accepting new feature contributions.
yindo commented 2026-02-16 00:19:44 -05:00
Author
Owner
Copy Link
Copy Source

@ewiner commented on GitHub (Nov 22, 2024):

My understanding is that LangServe and LangChain are open-source, while LangGraph Server is a commercial product with closed-source dependencies and limitations on free usage (according to the deployment options page). Is that correct?

@ewiner commented on GitHub (Nov 22, 2024): My understanding is that LangServe and LangChain are open-source, while LangGraph Server is a commercial product with closed-source dependencies and limitations on free usage (according to the [deployment options page](https://github.com/langchain-ai/langgraph/blob/main/docs/docs/concepts/deployment_options.md)). Is that correct?
yindo commented 2026-02-16 00:19:44 -05:00
Author
Owner
Copy Link
Copy Source

@eyurtsev commented on GitHub (Dec 2, 2024):

Yes, it's a commercial offering. The free tier option allows up to 1 million nodes executions and has an option for self hosted deployment (https://github.com/langchain-ai/langgraph/blob/main/docs/docs/concepts/deployment_options.md#self-hosted-lite).

@eyurtsev commented on GitHub (Dec 2, 2024): Yes, it's a commercial offering. The free tier option allows up to 1 million nodes executions and has an option for self hosted deployment (https://github.com/langchain-ai/langgraph/blob/main/docs/docs/concepts/deployment_options.md#self-hosted-lite).
yindo commented 2026-02-16 00:19:44 -05:00
Author
Owner
Copy Link
Copy Source

@eyurtsev commented on GitHub (Dec 19, 2024):

@prise6, @madoe001, @timvw, @aaronvenezia, @laithalsaadoon, @heidar, @teeppp, @cycleuser0x1 would appreciate any feedback on the 👎 .

Is there something that you'd like LangGraph to do that it doesn't but LangServe does?

@eyurtsev commented on GitHub (Dec 19, 2024): @prise6, @madoe001, @timvw, @aaronvenezia, @laithalsaadoon, @heidar, @teeppp, @cycleuser0x1 would appreciate any feedback on the :-1: . Is there something that you'd like LangGraph to do that it doesn't but LangServe does?
yindo commented 2026-02-16 00:19:44 -05:00
Author
Owner
Copy Link
Copy Source

@chai3 commented on GitHub (Dec 28, 2024):

This news made me sad.
My chain doesn't need LangGraph's memory or checkpoints.
LangGraph requires Postgresql and Radis, which makes the infrastructure cumbersome.
I want to host my Chain with simple infrastructure and add it to the existing FastAPI routes (langserve.add_rouets).
I run LangServe with:
AWS Lambda + web adapter
AWS AppRunner

Updated: In my use case, Model Context Protocol(MCP) might be the destination
https://github.com/tadata-org/fastapi_mcp
https://github.com/modelcontextprotocol/python-sdk

@chai3 commented on GitHub (Dec 28, 2024): This news made me sad. My chain doesn't need LangGraph's memory or checkpoints. LangGraph requires Postgresql and Radis, which makes the infrastructure cumbersome. I want to host my Chain with simple infrastructure and add it to the existing FastAPI routes (langserve.add_rouets). I run LangServe with: AWS Lambda + web adapter AWS AppRunner --- Updated: In my use case, Model Context Protocol(MCP) might be the destination https://github.com/tadata-org/fastapi_mcp https://github.com/modelcontextprotocol/python-sdk
yindo commented 2026-02-16 00:19:44 -05:00
Author
Owner
Copy Link
Copy Source

@theagenticguy commented on GitHub (Dec 28, 2024):

TBH the news is disappointing because all the new serving features are
behind a Langsmith key 🤷

On Sat, Dec 28, 2024, 3:04 AM chai3 @.***> wrote:

This news made me sad.
My chain doesn't need LangGraph's memory or checkpoints.
LangGraph requires Postgresql and Radis, which makes the infrastructure
cumbersome.
I want to host my Chain with simple infrastructure and add it to the
existing FastAPI routes (langserve.add_rouets).
I run LangServe with:
AWS Lambda + web adapter
AWS AppRunner

—
Reply to this email directly, view it on GitHub
https://github.com/langchain-ai/langserve/issues/791#issuecomment-2564297354,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACI4QLQL2PTET3NXKU2ECCD2H2AVLAVCNFSM6AAAAABSAAQJHSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNRUGI4TOMZVGQ
.
You are receiving this because you were mentioned.Message ID:
@.***>

@theagenticguy commented on GitHub (Dec 28, 2024): TBH the news is disappointing because all the **new** serving features are behind a Langsmith key 🤷 On Sat, Dec 28, 2024, 3:04 AM chai3 ***@***.***> wrote: > This news made me sad. > My chain doesn't need LangGraph's memory or checkpoints. > LangGraph requires Postgresql and Radis, which makes the infrastructure > cumbersome. > I want to host my Chain with simple infrastructure and add it to the > existing FastAPI routes (langserve.add_rouets). > I run LangServe with: > AWS Lambda + web adapter > AWS AppRunner > > — > Reply to this email directly, view it on GitHub > <https://github.com/langchain-ai/langserve/issues/791#issuecomment-2564297354>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/ACI4QLQL2PTET3NXKU2ECCD2H2AVLAVCNFSM6AAAAABSAAQJHSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNRUGI4TOMZVGQ> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >
yindo commented 2026-02-16 00:19:45 -05:00
Author
Owner
Copy Link
Copy Source

@aaronvenezia commented on GitHub (Dec 28, 2024):

Feels like a rug pull to me. You built a tool for deployment just to abandon it for a commercial one with your now captive developers that have invested time in building with your tool. I'm fine with commercial products, but (just my opinion) the new offering shouldn't have a limitation when it comes to self deployment. That would make the transition a lot easier to swallow. I understand that's what happens sometimes, it's just a little disappointing.

That said, you guys build a lot of great tools and I very much appreciate all that you provide in the AI framework space. Thank you for all you do.

@aaronvenezia commented on GitHub (Dec 28, 2024): Feels like a rug pull to me. You built a tool for deployment just to abandon it for a commercial one with your now captive developers that have invested time in building with your tool. I'm fine with commercial products, but (just my opinion) the new offering shouldn't have a limitation when it comes to self deployment. That would make the transition a lot easier to swallow. I understand that's what happens sometimes, it's just a little disappointing. That said, you guys build a lot of great tools and I very much appreciate all that you provide in the AI framework space. Thank you for all you do.
yindo commented 2026-02-16 00:19:45 -05:00
Author
Owner
Copy Link
Copy Source

@crawlregister commented on GitHub (Apr 4, 2025):

I'm confused by the deployment documentation. It seems to focus entirely on options through the LangGraph Platform, which is a commercial product with free tier limitations.

I am building a AI agent application with LangGraph and don't know the history before LangGraph Platform.

How can I deploy without LangGraph Platform?

@crawlregister commented on GitHub (Apr 4, 2025): I'm confused by the [deployment documentation](https://langchain-ai.github.io/langgraph/tutorials/deployment/). It seems to focus entirely on options through the LangGraph Platform, which is a commercial product with free tier limitations. I am building a AI agent application with LangGraph and don't know the history before LangGraph Platform. How can I deploy without LangGraph Platform?
yindo commented 2026-02-16 00:19:45 -05:00
Author
Owner
Copy Link
Copy Source

@ibbybuilds commented on GitHub (May 19, 2025):

@crawlregister I am also facing a similar issue. Did you find a solution?

@ibbybuilds commented on GitHub (May 19, 2025): @crawlregister I am also facing a similar issue. Did you find a solution?
yindo commented 2026-02-16 00:19:45 -05:00
Author
Owner
Copy Link
Copy Source

@igormarfin commented on GitHub (Jul 25, 2025):

Have a look at
https://github.com/JoshuaC215/agent-service-toolkit/tree/2e6c6228f3e51311434922953dd2202fcabc5f0c

@igormarfin commented on GitHub (Jul 25, 2025): Have a look at https://github.com/JoshuaC215/agent-service-toolkit/tree/2e6c6228f3e51311434922953dd2202fcabc5f0c
yindo commented 2026-02-16 00:19:45 -05:00
Author
Owner
Copy Link
Copy Source

@ibbybuilds commented on GitHub (Aug 3, 2025):

I've been working on an open-source alternative to LangGraph Platform that addresses these exact concerns.

Agent Protocol Server: https://github.com/ibbybuilds/agent-protocol-server

What it provides:

  • ✅ Self-hosted deployment (no commercial dependencies)
  • ✅ PostgreSQL persistence
  • ✅ Agent Protocol compliance
  • ✅ FastAPI-based (fits into existing infrastructure)
  • ✅ Zero vendor lock-in
  • ✅ Custom authentication support

Why I built it:

  • LangGraph Platform's self-hosted tier is limited (no custom auth)
  • SaaS pricing is expensive for production use
  • Community needs a truly open-source deployment solution

Current status: MVP ready, working on production hardening. Looking for contributors to help shape the roadmap.

This gives developers an alternative that doesn't require LangGraph Platform while maintaining compatibility with LangGraph workflows.

@ibbybuilds commented on GitHub (Aug 3, 2025): I've been working on an open-source alternative to LangGraph Platform that addresses these exact concerns. **Agent Protocol Server**: https://github.com/ibbybuilds/agent-protocol-server **What it provides:** - ✅ Self-hosted deployment (no commercial dependencies) - ✅ PostgreSQL persistence - ✅ Agent Protocol compliance - ✅ FastAPI-based (fits into existing infrastructure) - ✅ Zero vendor lock-in - ✅ Custom authentication support **Why I built it:** - LangGraph Platform's self-hosted tier is limited (no custom auth) - SaaS pricing is expensive for production use - Community needs a truly open-source deployment solution **Current status:** MVP ready, working on production hardening. Looking for contributors to help shape the roadmap. This gives developers an alternative that doesn't require LangGraph Platform while maintaining compatibility with LangGraph workflows.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
duplicate
enhancement
help wanted
in-progress
investigate
not langserve
playground
pull-request
Mirrored from GitHub Pull Request
 question
stale
streaming
unable-to-reproduce
wontfix
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/langserve#239
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?