langchain-ai/docs
1
0
Fork 0
mirror of https://github.com/langchain-ai/docs.git synced 2026-07-22 20:35:34 -04:00
Code Issues 490 Packages Projects Releases Wiki Activity

[PR #2935] [CLOSED] docs: add modal-gpu-ez integration #3018

New Issue
Closed
opened 2026-06-05 18:20:50 -04:00 by yindo · 0 comments
yindo commented 2026-06-05 18:20:50 -04:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/docs/pull/2935
Author: @algocean1204
Created: 3/5/2026
Status: ❌ Closed

Base: main ← Head: docs/add-modal-gpu-ez-integration

📝 Commits (2)

  • 820b00c docs: add modal-gpu-ez integration
  • 65b34de Merge branch 'main' into docs/add-modal-gpu-ez-integration

📊 Changes

3 files changed (+215 additions, -0 deletions)

View changed files

➕ src/oss/python/integrations/llms/modal_gpu_ez.mdx (+90 -0)
➕ src/oss/python/integrations/providers/modal_gpu_ez.mdx (+40 -0)
➕ src/oss/python/integrations/text_embedding/modal_gpu_ez.mdx (+85 -0)

📄 Description

Summary

Add documentation for langchain-modal-gpu-ez, a LangChain integration that wraps modal-gpu-ez for running HuggingFace models on Modal serverless GPUs.

Note: This is different from the existing langchain-modal (sandbox). langchain-modal-gpu-ez provides LLM and Embeddings interfaces for direct model inference.

What's added

  • Provider page (providers/modal_gpu_ez.mdx): Overview, installation, setup
  • LLM page (llms/modal_gpu_ez.mdx): ModalGpuEzLLM usage with GPU selection guide
  • Embeddings page (text_embedding/modal_gpu_ez.mdx): ModalGpuEzEmbeddings usage with vector store example

Package features

  • One-liner inference: llm.invoke("Hello") on T4/A100/H100 GPUs
  • Auto GPU selection based on model size
  • Local fallback (CUDA/MPS/CPU) at no cost
  • Built-in cost tracking and budget management

Links

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/docs/pull/2935 **Author:** [@algocean1204](https://github.com/algocean1204) **Created:** 3/5/2026 **Status:** ❌ Closed **Base:** `main` ← **Head:** `docs/add-modal-gpu-ez-integration` --- ### 📝 Commits (2) - [`820b00c`](https://github.com/langchain-ai/docs/commit/820b00ca180349b65d5249fa8e8fbdeb31d483d9) docs: add modal-gpu-ez integration - [`65b34de`](https://github.com/langchain-ai/docs/commit/65b34de92940314e181c3d2e2754ba599c62bc8f) Merge branch 'main' into docs/add-modal-gpu-ez-integration ### 📊 Changes **3 files changed** (+215 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `src/oss/python/integrations/llms/modal_gpu_ez.mdx` (+90 -0) ➕ `src/oss/python/integrations/providers/modal_gpu_ez.mdx` (+40 -0) ➕ `src/oss/python/integrations/text_embedding/modal_gpu_ez.mdx` (+85 -0) </details> ### 📄 Description ## Summary Add documentation for [`langchain-modal-gpu-ez`](https://pypi.org/project/langchain-modal-gpu-ez/), a LangChain integration that wraps [`modal-gpu-ez`](https://pypi.org/project/modal-gpu-ez/) for running HuggingFace models on Modal serverless GPUs. **Note**: This is different from the existing `langchain-modal` (sandbox). `langchain-modal-gpu-ez` provides **LLM and Embeddings** interfaces for direct model inference. ### What's added - **Provider page** (`providers/modal_gpu_ez.mdx`): Overview, installation, setup - **LLM page** (`llms/modal_gpu_ez.mdx`): `ModalGpuEzLLM` usage with GPU selection guide - **Embeddings page** (`text_embedding/modal_gpu_ez.mdx`): `ModalGpuEzEmbeddings` usage with vector store example ### Package features - One-liner inference: `llm.invoke("Hello")` on T4/A100/H100 GPUs - Auto GPU selection based on model size - Local fallback (CUDA/MPS/CPU) at no cost - Built-in cost tracking and budget management ### Links - PyPI: https://pypi.org/project/langchain-modal-gpu-ez/ - PyPI (core): https://pypi.org/project/modal-gpu-ez/ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-06-05 18:20:50 -04:00
yindo closed this issue 2026-06-05 18:20:50 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
deepagents
docs-infra
external
external
help wanted
integration
internal
internal
javascript
js/ts
langchain
langgraph
langsmith
needs-title
pull-request
Mirrored from GitHub Pull Request
 python
reference
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#3018
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?