96 Commits

Author SHA1 Message Date
John Kennedy cd26c43f7b Merge pull request #49 from langchain-ai/dependabot/uv/uv-534c4bb41b
chore(deps): bump the uv group across 1 directory with 2 updates
2026-05-26 01:11:01 -07:00
dependabot[bot] 3d72bab178 chore(deps): bump the uv group across 1 directory with 2 updates
Bumps the uv group with 2 updates in the / directory: [langsmith](https://github.com/langchain-ai/langsmith-sdk) and [idna](https://github.com/kjd/idna).


Updates `langsmith` from 0.7.31 to 0.8.0
- [Release notes](https://github.com/langchain-ai/langsmith-sdk/releases)
- [Commits](https://github.com/langchain-ai/langsmith-sdk/compare/v0.7.31...v0.8.0)

Updates `idna` from 3.11 to 3.15
- [Release notes](https://github.com/kjd/idna/releases)
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.md)
- [Commits](https://github.com/kjd/idna/compare/v3.11...v3.15)

---
updated-dependencies:
- dependency-name: langsmith
  dependency-version: 0.8.0
  dependency-type: direct:production
  dependency-group: uv
- dependency-name: idna
  dependency-version: '3.15'
  dependency-type: indirect
  dependency-group: uv
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-26 08:09:40 +00:00
John Kennedy 8db82e6a2c Merge pull request #48 from langchain-ai/dependabot/uv/uv-c30c77f42d
chore(deps): bump urllib3 from 2.6.3 to 2.7.0 in the uv group across 1 directory
2026-05-26 01:06:57 -07:00
dependabot[bot] d9a078bce7 chore(deps): bump urllib3 in the uv group across 1 directory
Bumps the uv group with 1 update in the / directory: [urllib3](https://github.com/urllib3/urllib3).


Updates `urllib3` from 2.6.3 to 2.7.0
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.3...2.7.0)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-version: 2.7.0
  dependency-type: indirect
  dependency-group: uv
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-11 17:07:59 +00:00
John Kennedy aeeb7b41d7 Merge pull request #47 from langchain-ai/dependabot/uv/uv-166555e348
chore(deps): bump the uv group across 1 directory with 2 updates
2026-05-01 23:07:43 -07:00
dependabot[bot] 0ad7c8186c chore(deps): bump the uv group across 1 directory with 2 updates
Bumps the uv group with 2 updates in the / directory: [python-dotenv](https://github.com/theskumar/python-dotenv) and [langsmith](https://github.com/langchain-ai/langsmith-sdk).


Updates `python-dotenv` from 1.2.1 to 1.2.2
- [Release notes](https://github.com/theskumar/python-dotenv/releases)
- [Changelog](https://github.com/theskumar/python-dotenv/blob/main/CHANGELOG.md)
- [Commits](https://github.com/theskumar/python-dotenv/compare/v1.2.1...v1.2.2)

Updates `langsmith` from 0.6.3 to 0.7.31
- [Release notes](https://github.com/langchain-ai/langsmith-sdk/releases)
- [Commits](https://github.com/langchain-ai/langsmith-sdk/commits/v0.7.31)

---
updated-dependencies:
- dependency-name: python-dotenv
  dependency-version: 1.2.2
  dependency-type: direct:production
  dependency-group: uv
- dependency-name: langsmith
  dependency-version: 0.7.31
  dependency-type: direct:production
  dependency-group: uv
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-04-28 08:25:54 +00:00
John Kennedy f0a64845f3 Merge pull request #46 from langchain-ai/dependabot/uv/uv-590e9db7b9
chore(deps): bump pytest from 9.0.2 to 9.0.3 in the uv group across 1 directory
2026-04-28 01:23:42 -07:00
dependabot[bot] 406a633203 chore(deps): bump pytest in the uv group across 1 directory
Bumps the uv group with 1 update in the / directory: [pytest](https://github.com/pytest-dev/pytest).


Updates `pytest` from 9.0.2 to 9.0.3
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/9.0.2...9.0.3)

---
updated-dependencies:
- dependency-name: pytest
  dependency-version: 9.0.3
  dependency-type: direct:production
  dependency-group: uv
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-04-14 02:27:45 +00:00
John Kennedy d753e25a53 Merge pull request #45 from langchain-ai/dependabot/uv/uv-aa7cb66ac2
chore(deps): bump requests from 2.32.5 to 2.33.0 in the uv group across 1 directory
2026-04-03 18:40:49 -07:00
dependabot[bot] 13ff07e282 chore(deps): bump requests in the uv group across 1 directory
Bumps the uv group with 1 update in the / directory: [requests](https://github.com/psf/requests).


Updates `requests` from 2.32.5 to 2.33.0
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.32.5...v2.33.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-version: 2.33.0
  dependency-type: direct:production
  dependency-group: uv
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-03-26 18:06:04 +00:00
John Kennedy e3aacb10e8 Merge pull request #44 from langchain-ai/dependabot/uv/langsmith-0.6.3
chore(deps): bump langsmith from 0.4.56 to 0.6.3
2026-03-18 22:03:32 -07:00
dependabot[bot] 71384f888e chore(deps): bump langsmith from 0.4.56 to 0.6.3
Bumps [langsmith](https://github.com/langchain-ai/langsmith-sdk) from 0.4.56 to 0.6.3.
- [Release notes](https://github.com/langchain-ai/langsmith-sdk/releases)
- [Commits](https://github.com/langchain-ai/langsmith-sdk/commits)

---
updated-dependencies:
- dependency-name: langsmith
  dependency-version: 0.6.3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-03-19 05:02:47 +00:00
John Kennedy 438c893bec Merge pull request #43 from langchain-ai/dependabot/uv/orjson-3.11.6
chore(deps): bump orjson from 3.11.5 to 3.11.6
2026-03-18 22:01:37 -07:00
dependabot[bot] fd740efd3b chore(deps): bump orjson from 3.11.5 to 3.11.6
Bumps [orjson](https://github.com/ijl/orjson) from 3.11.5 to 3.11.6.
- [Release notes](https://github.com/ijl/orjson/releases)
- [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md)
- [Commits](https://github.com/ijl/orjson/compare/3.11.5...3.11.6)

---
updated-dependencies:
- dependency-name: orjson
  dependency-version: 3.11.6
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-03-19 05:01:04 +00:00
Palash Shah 250bb4a6bb Merge pull request #42 from langchain-ai/palash/divert-to-skills
advise to use langsmith skills
2026-03-04 11:55:16 -05:00
Palash Shah a4a1a75e59 advise to use langsmith skills 2026-03-04 11:50:04 -05:00
Palash Shah c2aed47f85 Merge pull request #41 from langchain-ai/palash/add-deprecation-notice
add deprecation notice for fetch
2026-03-03 10:08:11 -05:00
Palash Shah 83d6a1eacb add deprecation notice for fetch 2026-03-03 10:03:46 -05:00
John Kennedy 52fe117f0c Merge pull request #38 from langchain-ai/dependabot/uv/urllib3-2.6.3
chore(deps): bump urllib3 from 2.6.1 to 2.6.3
2026-02-06 12:15:33 -08:00
dependabot[bot] c9e78b62a9 chore(deps): bump urllib3 from 2.6.1 to 2.6.3
Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.6.1 to 2.6.3.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/2.6.1...2.6.3)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-version: 2.6.3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-02-06 20:08:31 +00:00
John Kennedy c050fd812e Merge pull request #37 from langchain-ai/workflow-autofix
Potential fix for code scanning alert no. 1: Workflow does not contain permissions
2026-02-06 12:07:25 -08:00
John Kennedy 27915e986b fix: Workflow does not contain permissions
Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
2026-02-06 12:05:40 -08:00
Lance Martin 3a83a78bf0 Merge pull request #23 from langchain-ai/rlm/test-id-w-traces
fix: validate UUID inputs and add metadata flags to trace command
v0.3.1
2025-12-12 11:46:33 -08:00
Lance Martin 38c290b0c9 test: fix threads UUID validation test to provide project-uuid 2025-12-12 11:45:19 -08:00
Lance Martin 6c5feb55c0 Merge pull request #21 from cyberdak/patch-1
add langsmith_endpoint
2025-12-12 11:43:59 -08:00
Lance Martin cc562c6be5 chore: bump version to 0.3.1 2025-12-12 11:40:43 -08:00
Lance Martin 73a99d6469 fix: validate UUID inputs and add metadata flags to trace command
- Add UUID validation to traces/threads commands to prevent confusion
  when users mistakenly pass trace/thread IDs instead of directory paths
- Add --include-metadata and --include-feedback flags to trace command
  for consistency with traces command (both now default to off)
- Update tests to cover new validation and flag behavior
2025-12-12 11:39:45 -08:00
cyberdak a3a5727478 add langsmith_endpoint 2025-12-12 11:15:58 +08:00
Lance Martin 4737526a86 Merge pull request #20 from langchain-ai/rlm/readme-improve
docs: improve README and remove config set command
2025-12-11 15:41:16 -08:00
Lance Martin 8fdd9cb329 docs: remove redundant priority order section
The priority order information is already covered in the Configuration
section and doesn't need to be repeated here.
2025-12-11 15:38:33 -08:00
Lance Martin ce9f783dca docs: add usage example image
Add usage-example.jpg referenced in README quickstart section.
2025-12-11 15:37:02 -08:00
Lance Martin 3c38dffb1c fix: preserve chronological order when fetching threads concurrently
The fetch_recent_threads function was using as_completed() which returns
futures in completion order (non-deterministic), not in chronological
order. This caused test failures where threads would be returned in
the wrong order.

Added sorting after all futures complete to restore the original
chronological ordering from the runs query.
2025-12-11 15:36:13 -08:00
Lance Martin d8befc7953 docs: improve README and remove config set command
- Simplify quickstart section with concise examples
- Add usage-example.jpg image
- Add metadata/feedback flag examples
- Create comprehensive flags table
- Clean up project UUID configuration section
- Update test count from 50 to 71
- Remove config set command (project-name + project-uuid must be paired)
- Remove config set tests

The config set command was removed because the config now stores both
project-name and project-uuid atomically. Allowing users to set just
the UUID would create inconsistent state. Users can edit the YAML file
directly if needed.
2025-12-11 15:30:09 -08:00
Lance Martin 95487f0a49 Merge pull request #19 from langchain-ai/rlm/debugging
fix: multiple bug fixes and improvements to trace fetching
2025-12-11 14:35:35 -08:00
Lance Martin 91cf2caa18 fix: handle list type for trace_data in directory output mode
When saving traces to a directory without --include-metadata flag,
trace_data is a list of messages rather than a dict. Added type
checking to handle both cases correctly.

Also added comprehensive tests for the traces command directory
output mode, which was previously untested.
2025-12-11 14:05:47 -08:00
Lance Martin 4c4a410ccd fix: restore Rich panel formatting for pretty mode without metadata 2025-12-11 13:23:57 -08:00
Lance Martin 0be6f45721 feat: add progress bars for all trace and thread fetches
- Show progress bar for single trace fetches (removed optimization that skipped it)
- Add concurrent fetching with progress bar to threads command
- Add --no-progress and --max-concurrent flags to threads command
- Progress bar now displays "Fetching X/Y traces..." or "Fetching X/Y threads..."

Improves UX by providing visual feedback for all fetch operations,
even when fetching a single item.
2025-12-11 13:14:52 -08:00
Lance Martin 2ff984aeee perf: optimize trace fetching and fix config key duplication
- Make metadata and feedback fetching opt-in (default: OFF)
  - Changes default from include_metadata=True to False in fetch_recent_traces
  - Changes default from include_feedback=True to False
  - Improves single trace fetch time from ~4-5s to ~3s

- Add optional flags for metadata/feedback
  - Add --include-metadata flag to traces command
  - Add --include-feedback flag to traces command
  - Allows users to opt-in when they need extra data

- Standardize config keys to hyphen format
  - Normalize all config keys to hyphen format (project-uuid, project-name)
  - Update set_config_value() to convert underscores to hyphens
  - Add cleanup logic to remove duplicate underscore keys
  - Fixes bug where both project-uuid and project_uuid existed in config

Performance impact: Single trace fetch improved from 4-5s to ~3s by
eliminating unnecessary metadata/feedback API calls by default.
2025-12-11 13:08:03 -08:00
Lance Martin 287353762d Merge pull request #16 from langchain-ai/rlm/metadata-and-feedback
feat: add run metadata and feedback support
2025-12-11 12:16:43 -08:00
Lance Martin 345c6028d8 Merge pull request #17 from langchain-ai/rlm/improve-config-updating
feat: sync config UUID with LANGSMITH_PROJECT env var
2025-12-11 12:13:32 -08:00
Lance Martin 1448d491d3 Merge pull request #15 from langchain-ai/rlm/improve-help-message
docs: improve help message to highlight config show command
2025-12-11 12:13:16 -08:00
Lance Martin 5e5d4dbecd docs: improve help message to highlight config show command
Add CONFIGURATION section to main help and reorganize config examples
to prominently display 'config show' command, making it easier for users
to discover how to check their current configuration.
2025-12-11 12:08:22 -08:00
Lance Martin 71269b7e14 fix: correct test assertions and mock configurations
- Fix test_cli.py assertions to check for lowercase message types (human/user)
  instead of uppercase (HUMAN/USER) to match formatter output
- Fix test_fetchers.py mock run objects to include required attributes
  (feedback_stats, start_time, end_time, extra) to prevent "Mock object
  is not iterable" errors
- Add include_metadata=False and include_feedback=False to
  fetch_recent_traces test calls for backward-compatible behavior

All 61 tests now pass, including in clean environment (CI-compatible).
2025-12-11 12:00:31 -08:00
Lance Martin 4df37da2f3 feat: sync config UUID with LANGSMITH_PROJECT env var
Store project name alongside UUID in config to detect staleness.
When LANGSMITH_PROJECT changes, automatically re-fetch UUID and update config.

Changes:
- Add _update_project_config() helper for atomic config updates
- Rewrite get_project_uuid() with sync detection logic
- Clear in-memory cache when project_uuid manually set
- Update priority: LANGSMITH_PROJECT_UUID > sync check > config fallback

Benefits:
- Automatic UUID sync when project name changes
- No API call when project unchanged (string comparison only)
- Backwards compatible with legacy configs
- Explicit override via LANGSMITH_PROJECT_UUID still works

Tests:
- Add 10 comprehensive test cases for sync detection
- Fix existing tests to clear env vars for config fallback
- All 71 tests passing
2025-12-11 11:39:48 -08:00
Lance Martin ff99f1cd28 feat: add run metadata and feedback support
- Add metadata extraction (status, timing, tokens, costs, custom fields)
- Implement smart feedback fetching (only when feedback exists)
- Create new fetcher functions with metadata support
- Update formatters to display metadata and feedback in all formats
- Update all CLI commands (trace, thread, traces, threads)
- Add comprehensive migration guide in README
- Bump version to 0.3.0

BREAKING CHANGE: Output format changed from list to structured dict with messages, metadata, and feedback keys
2025-12-11 11:01:26 -08:00
Lance Martin 2076ffc0a9 Merge pull request #14 from langchain-ai/dqbd/base-url-config
feat(config): allow setting base-url via CLI
2025-12-11 10:18:09 -08:00
Tat Dat Duong 7e749817b7 feat(config): allow setting base-url via CLI 2025-12-11 15:38:37 +01:00
Lance Martin cc05ca41ff Update README with usage instructions for langsmith-fetch
Added usage instructions for fetching recent traces and threads.
2025-12-10 21:52:09 -08:00
Lance Martin 0af334162f chore: bump version to 0.2.0 v0.2.0 2025-12-10 21:26:21 -08:00
Lance Martin 8ea36a8c75 Merge pull request #10 from langchain-ai/dqbd/exclude-pending
fix: exclude pending traces
2025-12-10 20:37:06 -08:00