[PR #433] [MERGED] add harness based on harbor #657

Closed
opened 2026-02-16 09:16:44 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/deepagents/pull/433
Author: @eyurtsev
Created: 11/19/2025
Status: Merged
Merged: 11/25/2025
Merged by: @eyurtsev

Base: masterHead: eugene/add_harbor


📝 Commits (10+)

📊 Changes

13 files changed (+4357 additions, -0 deletions)

View changed files

📝 .github/workflows/ci.yml (+6 -0)
libs/harbor/Makefile (+73 -0)
libs/harbor/README.md (+3 -0)
libs/harbor/deepagents_harbor/__init__.py (+5 -0)
libs/harbor/deepagents_harbor/agents/__init__.py (+7 -0)
libs/harbor/deepagents_harbor/agents/backend.py (+332 -0)
libs/harbor/deepagents_harbor/agents/main.py (+233 -0)
libs/harbor/deepagents_harbor/tracing.py (+234 -0)
libs/harbor/pyproject.toml (+55 -0)
libs/harbor/scripts/analyze.py (+137 -0)
libs/harbor/scripts/create_langsmith_dataset.py (+156 -0)
libs/harbor/tests/unit_tests/test_imports.py (+5 -0)
libs/harbor/uv.lock (+3111 -0)

📄 Description

Initial port of vivek's benchmarking code based on harbor.

Follow up TODOs:

  • Add async implementations for backend
  • Add non python3 option for the sandbox underlying implementations (as most of the file operations are failing right now)
  • Fix up the adapters for langsmith
  • Reorganize code

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/deepagents/pull/433 **Author:** [@eyurtsev](https://github.com/eyurtsev) **Created:** 11/19/2025 **Status:** ✅ Merged **Merged:** 11/25/2025 **Merged by:** [@eyurtsev](https://github.com/eyurtsev) **Base:** `master` ← **Head:** `eugene/add_harbor` --- ### 📝 Commits (10+) - [`22d0c54`](https://github.com/langchain-ai/deepagents/commit/22d0c545cd572a981c1b573140663e264cb28e69) Initial port from vivek - [`caabc15`](https://github.com/langchain-ai/deepagents/commit/caabc1538d8d1fb9ba0f48a2ed730cc74628fb93) x - [`85864ce`](https://github.com/langchain-ai/deepagents/commit/85864ce0e527a109acd2d6de96da109c1e29a6ea) x - [`c4d0861`](https://github.com/langchain-ai/deepagents/commit/c4d08613ec4c005dbead0f10ed24738398f55a17) x - [`99e242f`](https://github.com/langchain-ai/deepagents/commit/99e242f1eaefb59624e9e7b2e851de0443b9c042) x - [`27e097b`](https://github.com/langchain-ai/deepagents/commit/27e097bf87f1bfe0c3fed870655e892cb1ec8266) x - [`1754e42`](https://github.com/langchain-ai/deepagents/commit/1754e420365a8de866f2d9afeea29b0bc5c844f4) x - [`9e16afa`](https://github.com/langchain-ai/deepagents/commit/9e16afa9675bbb0b994b030577cf8f7d326ee47c) x - [`3259f40`](https://github.com/langchain-ai/deepagents/commit/3259f409089e7634fb71eccc2dfbbf812442e72e) x - [`ad12433`](https://github.com/langchain-ai/deepagents/commit/ad124336f30c70c8c676bf38b9634523fc019e44) x ### 📊 Changes **13 files changed** (+4357 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `.github/workflows/ci.yml` (+6 -0) ➕ `libs/harbor/Makefile` (+73 -0) ➕ `libs/harbor/README.md` (+3 -0) ➕ `libs/harbor/deepagents_harbor/__init__.py` (+5 -0) ➕ `libs/harbor/deepagents_harbor/agents/__init__.py` (+7 -0) ➕ `libs/harbor/deepagents_harbor/agents/backend.py` (+332 -0) ➕ `libs/harbor/deepagents_harbor/agents/main.py` (+233 -0) ➕ `libs/harbor/deepagents_harbor/tracing.py` (+234 -0) ➕ `libs/harbor/pyproject.toml` (+55 -0) ➕ `libs/harbor/scripts/analyze.py` (+137 -0) ➕ `libs/harbor/scripts/create_langsmith_dataset.py` (+156 -0) ➕ `libs/harbor/tests/unit_tests/test_imports.py` (+5 -0) ➕ `libs/harbor/uv.lock` (+3111 -0) </details> ### 📄 Description Initial port of vivek's benchmarking code based on harbor. Follow up TODOs: * Add async implementations for backend * Add non python3 option for the sandbox underlying implementations (as most of the file operations are failing right now) * Fix up the adapters for langsmith * Reorganize code --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 09:16:44 -05:00
yindo closed this issue 2026-02-16 09:16:44 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/deepagents#657