Releases - langchain-benchmarks - Free-Git: DMCA Non-Compliant

langchain-ai/langchain-benchmarks

mirror of https://github.com/langchain-ai/langchain-benchmarks.git synced 2026-07-01 01:37:54 -04:00

v0.0.14 301837e303

Compare
Stable

yindo released this 2024-07-24 11:00:17 -04:00 | 13 commits to main since this release
📅 Originally published on GitHub: Wed, 24 Jul 2024 15:01:05 GMT
🏷️ Git tag created: Wed, 24 Jul 2024 15:00:17 GMT

What's Changed
- minor: bump to langchain v2 by @baskaryan in https://github.com/langchain-ai/langchain-benchmarks/pull/191
- Release 0.0.14 by @baskaryan in https://github.com/langchain-ai/langchain-benchmarks/pull/194
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.13...v0.0.14
Downloads
- langchain_benchmarks-0.0.14-py3-none-any.whl
  71 KiB
  2026-02-16 00:17:48 -05:00
- langchain_benchmarks-0.0.14.tar.gz
  49 KiB
  2026-02-16 00:17:49 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.13 e4e26a3b8e

Compare
Stable

yindo released this 2024-07-24 10:56:47 -04:00 | 15 commits to main since this release
📅 Originally published on GitHub: Wed, 24 Jul 2024 14:57:25 GMT
🏷️ Git tag created: Wed, 24 Jul 2024 14:56:47 GMT

What's Changed
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/184
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/185
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/186
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/187
- tool benchmarking by @isahers1 in https://github.com/langchain-ai/langchain-benchmarks/pull/190
- Release 0.0.13 by @baskaryan in https://github.com/langchain-ai/langchain-benchmarks/pull/192
- infra: release permissions by @baskaryan in https://github.com/langchain-ai/langchain-benchmarks/pull/193
New Contributors
- @isahers1 made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/190
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.12...v0.0.13
Downloads
- langchain_benchmarks-0.0.13-py3-none-any.whl
  71 KiB
  2026-02-16 00:17:47 -05:00
- langchain_benchmarks-0.0.13.tar.gz
  50 KiB
  2026-02-16 00:17:47 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.12 820af98418

Compare
Stable

yindo released this 2024-04-18 13:38:38 -04:00 | 22 commits to main since this release
📅 Originally published on GitHub: Thu, 18 Apr 2024 17:42:17 GMT
🏷️ Git tag created: Thu, 18 Apr 2024 17:38:38 GMT

What's Changed
- Update benchmark all for agents by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/174
- remove tiny multiverse dataset from registry by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/175
- Update intro, remove adapter by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/177
- Simplify all tool usage notebooks by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/178
- Remove old code by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/176
- Add security policy by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/180
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/181
- Update benchmarks all notebook to use {question} instead of {input} by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/179
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/182
- Release 0.0.12 by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/183
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.11...v0.0.12
Downloads
- langchain_benchmarks-0.0.12-py3-none-any.whl
  66 KiB
  2026-02-16 00:17:45 -05:00
- langchain_benchmarks-0.0.12.tar.gz
  45 KiB
  2026-02-16 00:17:45 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.11 c1c5585d3a

Compare
Stable

yindo released this 2024-04-10 22:06:44 -04:00 | 32 commits to main since this release
📅 Originally published on GitHub: Tue, 16 Apr 2024 19:24:10 GMT
🏷️ Git tag created: Thu, 11 Apr 2024 02:06:44 GMT

What's Changed
- Update README.md to fix archived links by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/162
- Missing Word in comparing_techniques.ipynb by @MaruthiKo in https://github.com/langchain-ai/langchain-benchmarks/pull/160
- Add high cardinality benchmark by @baskaryan in https://github.com/langchain-ai/langchain-benchmarks/pull/164
- docs: include high cardinality by @baskaryan in https://github.com/langchain-ai/langchain-benchmarks/pull/165
- docs: add high cardinality links by @baskaryan in https://github.com/langchain-ai/langchain-benchmarks/pull/166
- update dependencies by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/167
- update model providers by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/168
- Add factory for regular tool using agents by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/169
- Update deps by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/170
- add tool calling benchmark notebook by @ccurme in https://github.com/langchain-ai/langchain-benchmarks/pull/171
- Fix list of env variables in benchmark all notebook by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/173
New Contributors
- @MaruthiKo made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/160
- @baskaryan made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/164
- @ccurme made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/171
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.10...v0.0.11
Downloads
- langchain_benchmarks-0.0.11-py3-none-any.whl
  80 KiB
  2026-02-16 00:17:43 -05:00
- langchain_benchmarks-0.0.11.tar.gz
  54 KiB
  2026-02-16 00:17:44 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.10 a0ea197b28

Compare
Stable

yindo released this 2023-12-20 09:24:06 -05:00 | 43 commits to main since this release
📅 Originally published on GitHub: Wed, 20 Dec 2023 14:24:09 GMT
🏷️ Git tag created: Wed, 20 Dec 2023 14:24:06 GMT

What's Changed
- Update min langsmith client by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/132
- Version 0.0.10 by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/133
- Update benchmark all notebook by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/134
- Add Anyscale Model by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/135
- Fix openai output parser used by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/138
- Add anthropic agent based on tool user repo by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/139
- 🐶 by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/136
- Parser Fix by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/142
- Run w/o langsmith by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/137
- Update openai function factory, update benchmark all by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/143
- OAI Assistant by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/144
- Update example in multiverse math by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/145
- Update notebooks by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/146
- Include assistant factory in benchmark all by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/147
- Update Benchmark All by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/148
- Add to toc by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/149
- Add Gemini by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/151
- Update Math Evaluator by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/152
- Change multiverse math to multiverse math (tiny) and add another multiverse math set by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/154
- Register the new dataset by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/155
- Add runnable agent factory by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/156
- Update evaluators by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/157
- updated Makefile by @leo-gan in https://github.com/langchain-ai/langchain-benchmarks/pull/153
New Contributors
- @leo-gan made their first contribution in https://github.com/langchain-ai/langchain-benchmarks/pull/153
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.9...v0.0.10
Downloads
- langchain_benchmarks-0.0.10-py3-none-any.whl
  78 KiB
  2026-02-16 00:17:42 -05:00
- langchain_benchmarks-0.0.10.tar.gz
  52 KiB
  2026-02-16 00:17:42 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.9 eb2d9e2b63

Compare
Stable

yindo released this 2023-12-14 13:25:13 -05:00 | 66 commits to main since this release
📅 Originally published on GitHub: Thu, 14 Dec 2023 18:25:59 GMT
🏷️ Git tag created: Thu, 14 Dec 2023 18:25:13 GMT

What's Changed
- Add semi-structured eval by @rlancemartin in https://github.com/langchain-ai/langchain-benchmarks/pull/83
- Minor clean, add Mixtral by @rlancemartin in https://github.com/langchain-ai/langchain-benchmarks/pull/123
- Add rate limiter by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/121
- Bump ruff fix up first party identity for import sorting by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/124
- Add contains to model registry by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/126
- remove with_rate_limit from public api by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/127
- Update fireworks models by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/128
- Add gemini mm examples by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/125
- Adds custom agents to the langchain benchmarking repo by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/120
- Add version by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/130
- Update notebooks, model registry and make release by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/131
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.8...v0.0.9
Downloads
- langchain_benchmarks-0.0.9-py3-none-any.whl
  68 KiB
  2026-02-16 00:17:39 -05:00
- langchain_benchmarks-0.0.9.tar.gz
  46 KiB
  2026-02-16 00:17:39 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.8 888fce5060

Compare
Stable

yindo released this 2023-12-12 11:39:05 -05:00 | 77 commits to main since this release
📅 Originally published on GitHub: Tue, 12 Dec 2023 16:39:51 GMT
🏷️ Git tag created: Tue, 12 Dec 2023 16:39:05 GMT

What's Changed
- Minor cleanup to multi-modal embeddings docs by @rlancemartin in https://github.com/langchain-ai/langchain-benchmarks/pull/105
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/107
- Update README.md by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/108
- Add Model Registry by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/110
- Update model registry by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/111
- Tool Tasks: Add eval params to task definition by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/112
- Update evaluator by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/113
- Add mixtral tool use examples by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/114
- Move mixtral models by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/115
- Add gpt-4 models by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/117
- Benchmark all tool usage notebook by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/118
- Release 0.0.8 by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/122
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.7...v0.0.8
Downloads
- langchain_benchmarks-0.0.8-py3-none-any.whl
  57 KiB
  2026-02-16 00:17:37 -05:00
- langchain_benchmarks-0.0.8.tar.gz
  39 KiB
  2026-02-16 00:17:38 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.7 8204930f2b

Compare
Stable

yindo released this 2023-12-05 16:14:44 -05:00 | 89 commits to main since this release
📅 Originally published on GitHub: Tue, 05 Dec 2023 21:18:56 GMT
🏷️ Git tag created: Tue, 05 Dec 2023 21:14:44 GMT

What's Changed
- Multi modal RAG benchmark by @rlancemartin in https://github.com/langchain-ai/langchain-benchmarks/pull/101
- 0.0.7 by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/104
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.6...v0.0.7
Downloads
- langchain_benchmarks-0.0.7-py3-none-any.whl
  54 KiB
  2026-02-16 00:17:36 -05:00
- langchain_benchmarks-0.0.7.tar.gz
  36 KiB
  2026-02-16 00:17:36 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.6 01ffffd04c

Compare
Stable

yindo released this 2023-12-03 21:28:51 -05:00 | 91 commits to main since this release
📅 Originally published on GitHub: Mon, 04 Dec 2023 02:32:36 GMT
🏷️ Git tag created: Mon, 04 Dec 2023 02:28:51 GMT

What's Changed
- Add chat categorization dataset by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/98
- Add Archived by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/53
- Update Chat Extraction Notebook by @hinthornw in https://github.com/langchain-ai/langchain-benchmarks/pull/102
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.5...v0.0.6
Downloads
- langchain_benchmarks-0.0.6-py3-none-any.whl
  51 KiB
  2026-02-16 00:17:34 -05:00
- langchain_benchmarks-0.0.6.tar.gz
  35 KiB
  2026-02-16 00:17:35 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)
v0.0.5 30530883d4

Compare
Stable

yindo released this 2023-12-01 10:40:03 -05:00 | 94 commits to main since this release
📅 Originally published on GitHub: Fri, 01 Dec 2023 15:40:48 GMT
🏷️ Git tag created: Fri, 01 Dec 2023 15:40:03 GMT

What's Changed
- Clean up notebooks, and trim cells by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/97
- Make it easier to test non standard agents by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/99
- Release 0.0.5 by @eyurtsev in https://github.com/langchain-ai/langchain-benchmarks/pull/100
Full Changelog: https://github.com/langchain-ai/langchain-benchmarks/compare/v0.0.4...v0.0.5
Downloads
- langchain_benchmarks-0.0.5-py3-none-any.whl
  47 KiB
  2026-02-16 00:17:33 -05:00
- langchain_benchmarks-0.0.5.tar.gz
  32 KiB
  2026-02-16 00:17:33 -05:00
- Source Code (ZIP)
- Source Code (TAR.GZ)