[PR #19] [MERGED] add benchmark data #28

New Issue

2026-02-16T04:15:16-05:00

yindo commented

2026-02-16 04:15:16 -05:00

📋 Pull Request Information

Original PR: https://github.com/run-llama/semtools/pull/19
Author: @logan-markewich
Created: 9/3/2025
Status: ✅ Merged
Merged: 9/4/2025
Merged by: @logan-markewich

Base: main ← Head: logan/workspace

📝 Commits (1)

b98e9d5 add benchmark data

📊 Changes

20 files changed (+5979 additions, -0 deletions)

View changed files

➕ benchmarks/arxiv/README.md (+40 -0)
➕ benchmarks/arxiv/answers/a_search_and_filter/1.txt (+160 -0)
➕ benchmarks/arxiv/answers/a_search_and_filter/2.txt (+45 -0)
➕ benchmarks/arxiv/answers/a_search_and_filter/3.txt (+265 -0)
➕ benchmarks/arxiv/answers/a_search_and_filter/4.txt (+43 -0)
➕ benchmarks/arxiv/answers/a_search_and_filter/5.txt (+256 -0)
➕ benchmarks/arxiv/answers/b_cross_reference_and_relationships/1.txt (+434 -0)
➕ benchmarks/arxiv/answers/b_cross_reference_and_relationships/2.txt (+290 -0)
➕ benchmarks/arxiv/answers/b_cross_reference_and_relationships/3.txt (+339 -0)
➕ benchmarks/arxiv/answers/b_cross_reference_and_relationships/4.txt (+299 -0)
➕ benchmarks/arxiv/answers/b_cross_reference_and_relationships/5.txt (+521 -0)
➕ benchmarks/arxiv/answers/c_temporal_analysis/1.txt (+480 -0)
➕ benchmarks/arxiv/answers/c_temporal_analysis/2.txt (+560 -0)
➕ benchmarks/arxiv/answers/c_temporal_analysis/3.txt (+376 -0)
➕ benchmarks/arxiv/answers/c_temporal_analysis/4.txt (+730 -0)
➕ benchmarks/arxiv/answers/c_temporal_analysis/5.txt (+282 -0)
➕ benchmarks/arxiv/download_arxiv_files.py (+674 -0)
➕ benchmarks/arxiv/plain_CLAUDE.md (+55 -0)
➕ benchmarks/arxiv/questions.txt (+21 -0)
➕ benchmarks/arxiv/search_CLAUDE.md (+109 -0)

📄 Description

Run a benchmark with some arxiv data, here's the results.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/run-llama/semtools/pull/19 **Author:** [@logan-markewich](https://github.com/logan-markewich) **Created:** 9/3/2025 **Status:** ✅ Merged **Merged:** 9/4/2025 **Merged by:** [@logan-markewich](https://github.com/logan-markewich) **Base:** `main` ← **Head:** `logan/workspace` --- ### 📝 Commits (1) - [`b98e9d5`](https://github.com/run-llama/semtools/commit/b98e9d52335fc027fe3284277b145ecacc5b5d0a) add benchmark data ### 📊 Changes **20 files changed** (+5979 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `benchmarks/arxiv/README.md` (+40 -0) ➕ `benchmarks/arxiv/answers/a_search_and_filter/1.txt` (+160 -0) ➕ `benchmarks/arxiv/answers/a_search_and_filter/2.txt` (+45 -0) ➕ `benchmarks/arxiv/answers/a_search_and_filter/3.txt` (+265 -0) ➕ `benchmarks/arxiv/answers/a_search_and_filter/4.txt` (+43 -0) ➕ `benchmarks/arxiv/answers/a_search_and_filter/5.txt` (+256 -0) ➕ `benchmarks/arxiv/answers/b_cross_reference_and_relationships/1.txt` (+434 -0) ➕ `benchmarks/arxiv/answers/b_cross_reference_and_relationships/2.txt` (+290 -0) ➕ `benchmarks/arxiv/answers/b_cross_reference_and_relationships/3.txt` (+339 -0) ➕ `benchmarks/arxiv/answers/b_cross_reference_and_relationships/4.txt` (+299 -0) ➕ `benchmarks/arxiv/answers/b_cross_reference_and_relationships/5.txt` (+521 -0) ➕ `benchmarks/arxiv/answers/c_temporal_analysis/1.txt` (+480 -0) ➕ `benchmarks/arxiv/answers/c_temporal_analysis/2.txt` (+560 -0) ➕ `benchmarks/arxiv/answers/c_temporal_analysis/3.txt` (+376 -0) ➕ `benchmarks/arxiv/answers/c_temporal_analysis/4.txt` (+730 -0) ➕ `benchmarks/arxiv/answers/c_temporal_analysis/5.txt` (+282 -0) ➕ `benchmarks/arxiv/download_arxiv_files.py` (+674 -0) ➕ `benchmarks/arxiv/plain_CLAUDE.md` (+55 -0) ➕ `benchmarks/arxiv/questions.txt` (+21 -0) ➕ `benchmarks/arxiv/search_CLAUDE.md` (+109 -0) </details> ### 📄 Description Run a benchmark with some arxiv data, here's the results. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

yindo added the pull-request label 2026-02-16 04:15:16 -05:00

yindo closed this issue

2026-02-16 04:15:17 -05:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: run-llama/semtools#28