1edf4e5a03
docs(eval): inline pairwise judging prompt instead of pulling from hub ( #1002 )
...
The "Run a pairwise evaluation" example calls
`langchain.hub.pull("langchain-ai/pairwise-evaluation-2")`, which raises
`ValueError` on current `langsmith` versions: pulling public prompts now
requires `dangerously_pull_public_prompt=True`, and neither
`langchain.hub.pull` nor `langchain_classic.hub.pull` forwards the flag.
Two fixes were considered: (a) call `Client().pull_prompt(...,
dangerously_pull_public_prompt=True)` directly and add a callout, or (b)
inline the prompt and schema. This PR takes (b) — the system and human
messages are copied verbatim and `Score` is declared as a Pydantic model
bound via `with_structured_output`. It removes the dependency on the
broken wrapper, makes the schema visible on the page, and matches the
TypeScript example on the same page.
2026-05-05 11:34:49 -04:00
61bff431a2
docs: update api key docs for org-scoped keys ( #959 )
...
Updating create_account_api_key and index for new org-scoped keys and
SDK. Also updating create_api_key.pngs
Closes INF-784
2025-09-03 15:34:21 -04:00
adb2cb009e
docs: add a summary table to scaling docs ( #956 )
...
Adding a summary table at the top to avoid needing to scroll down to
each individual section
Closes INF-786
2025-08-26 09:37:05 -04:00
77af21763e
feat: Okta support for SCIM ( #949 )
...
* enhances existing SCIM documentation for Okta
* adds sections to SAML and OAuth2.0 docs for Okta
---------
Co-authored-by: Kathryn May <44557882+katmayb@users.noreply.github.com >
2025-08-21 17:20:40 -04:00
67114b7ebd
Fix queue helm values in TTL docs ( #954 )
...
Queue.extraEnv -> Queue.deployment.extraEnv
2025-08-21 21:25:05 +02:00
6cd3026566
Update sales links ( #950 )
...
Description: updates sales team links to point to our form.
Issue: DOC-170 (internal Linear ticket)
2025-08-19 08:12:09 -07:00
1bdaf91186
data compliance docs ( #945 )
...
Co-authored-by: Kathryn May <44557882+katmayb@users.noreply.github.com >
2025-08-15 18:36:17 +00:00
1483216652
docs: Adds ttft run tree docs ( #943 )
2025-08-13 11:43:02 -07:00
fcf5bc9093
fix: Typo on Claude Code tracing docs ( #937 )
...
Also adding a note on how OTEL events are limited in information
2025-08-12 10:29:44 -07:00
87140d696d
Add Clickhouse TTL job to TTL and Retention Section ( #936 )
2025-08-12 15:27:40 +02:00
27c28dadbd
docs: add helm upgrade instaed of install command ( #934 )
2025-08-12 09:06:04 -04:00
ab61ac8350
docs: Update AI SDK tracing docs for Next.js ( #933 )
2025-08-10 08:29:47 +00:00
614162ac3e
No run collector ( #930 )
2025-08-08 21:05:09 +00:00
7e9c4a000a
chore: Rm v2 suffixes ( #929 )
2025-08-08 13:58:40 -07:00
ca0e5bda2b
Update tracing_context ( #928 )
2025-08-08 20:48:10 +00:00
728ef28698
docs: Update column config heatmap instructions ( #925 )
2025-08-05 23:40:37 +00:00
537e556548
docs: update scale recommendation to account for read load ( #921 )
...
Updating the LS docs to consider not only traces per second but also
read load (number of users, query requests, etc).
2025-08-05 18:40:56 -04:00
ca58071eba
Fix typo ( #924 )
...
Fix typo!
2025-08-05 21:50:24 +00:00
3d47ad3e04
Docs for claude code tracing ( #923 )
...
Add docs for showing how to trace with Claude Code
2025-08-05 12:40:12 -07:00
e42486cb10
docs: Add docs for cached_hosts in pytest ( #922 )
2025-08-01 23:47:29 +00:00
550dad5141
Telemetry section in Egress docs + Examples ( #920 )
2025-07-31 21:43:13 -07:00
79580f36ea
add a how-to guide for the new LS trace <> LGP logs feature ( #916 )
2025-07-28 09:55:16 -07:00
dee7ded8fd
chore: additional details for bulk export permissions ( #917 )
2025-07-25 21:48:32 -04:00
8327af6ee8
docs: azure blob deletion support ( #915 )
...
We now support blob deletion in Azure!
2025-07-25 19:22:05 +00:00
bafecf085a
Updating headers + tracing project CTAs ( #892 )
...
Docs updates:
```- [x] Data retention
- [x] Dashboards
- [x] Alerts
Creating
- [ x] New automation
- [x] New evaluator – DONE for online evaluators. need to check offline
- [x] New alert
Viewing
- [x] evaluators
- [x] automations
- [x ] Update this page https://docs.smith.langchain.com/evaluation/how_to_guides/bind_evaluator_to_dataset which is partly covered in this PR https://github.com/langchain-ai/langsmith-docs/pull/837 ```
---------
Co-authored-by: eric-langchain <168655640+eric-langchain@users.noreply.github.com >
2025-07-25 11:11:16 -05:00
5f4eb95dd6
Add guide for online evals ( #913 )
...
Co-authored-by: isaac hershenson <ihershenson@hmc.edu >
2025-07-25 15:18:59 +00:00
53090e9550
Remove apostrophe in LS observability section ( #914 )
2025-07-25 00:22:22 +00:00
51bbc2c959
update online evals link ( #912 )
2025-07-24 13:25:26 -07:00
93bef9adcf
docs: add helm version for pg with environment variables ( #910 )
2025-07-23 16:59:59 -07:00
145fc25203
improve docs for attaching evaluator to dataset ( #837 )
...
Co-authored-by: Tanushree <87711021+tanushree-sharma@users.noreply.github.com >
Co-authored-by: Tanushree Sharma <tanushree@langchain.dev >
2025-07-23 16:01:17 -07:00
c606e57b45
docs: add minimum openshift version ( #908 )
2025-07-21 15:53:46 -04:00
e644d31103
chore: bump scheduled export version ( #907 )
...
closes ls-4140
2025-07-21 14:43:31 -04:00
c71cf30fe2
doc: clarify de-duplication of pager duty alert ( #906 )
...
Co-authored-by: suraj-langchain <suraj@langchain.dev >
2025-07-18 02:37:18 +00:00
2633d0145f
chore: bump SCIM corresponding version ( #905 )
2025-07-17 18:19:18 -04:00
b789186c75
add self hosted callout ( #904 )
2025-07-17 18:36:03 +00:00
80ab687fa0
feat: scheduled bulk exports ( #903 )
...
Co-authored-by: Kathryn May <44557882+katmayb@users.noreply.github.com >
2025-07-17 13:22:01 -04:00
c8c1160b10
Add evaluate_comparative callout on evaluations page ( #900 )
2025-07-15 09:00:08 -04:00
8724681dea
align evals tutorial LS-4098 ( #878 )
...
Co-authored-by: Tanushree Sharma <tanushree@langchain.dev >
Co-authored-by: Tanushree <87711021+tanushree-sharma@users.noreply.github.com >
2025-07-14 13:25:29 -07:00
bbd47eed00
docs: add wait command to helm install in docs ( #902 )
...
Let's push folks to install and upgrade with `--wait` so you can see if
pods come up properly during the deployment. This help prevent silent
failures in deployment.
Testing
I test `--wait` again to make sure no errors
2025-07-14 12:24:36 -04:00
f179ea521e
Remove deprecated off_the_shelf evaluators content ( #901 )
2025-07-14 11:03:28 -04:00
3a8baac646
Added the URL reference to LangChain Hub ( #890 )
...
Resolution for issue
https://github.com/langchain-ai/langsmith-docs/issues/854 -
Added the base URL reference for LangChain Hub for easier redirection
for the reader.
2025-07-11 17:22:12 +00:00
057d5b5cab
chore: SCIM documentation ( #889 )
2025-07-09 15:32:34 -04:00
9adfb329b4
chore: Note for https only for SSO ( #896 )
2025-07-09 10:04:00 -07:00
f2c5111887
chore: remove beta label for Azure blob storage ( #895 )
2025-07-08 14:22:38 -04:00
5165b9bbfb
docs: add truststore section in usage ( #893 )
2025-07-08 12:45:40 +00:00
6a32fd4001
Details for first token ( #888 )
2025-07-07 11:34:28 -07:00
3087e10a22
clarify AQ w many reviewers ( #886 )
2025-07-02 16:17:55 -07:00
c6eee0e768
Make it clearer in metrics docs that Host-Backend is LGP only ( #885 )
2025-07-02 10:40:31 -07:00
78b69f4e65
docs: Add more AI SDK docs ( #884 )
...
Customize run name and metadata
2025-07-01 16:26:04 -07:00
54c3f90959
Add public hub disclaimer ( #883 )
2025-07-01 15:54:47 -07:00
Paarth Ahuja