mirror of
https://github.com/expo/code-review-cli.git
synced 2026-11-15 17:30:42 -10:00
The evaluation scripts spawned the MCP as a subprocess and made live Brave, Algolia, and page requests, so they could not run in CI and had drifted: one fixture query no longer passes the current sanitizer, and both scripts exceed the per-server call budget added in v0.12.2. Run the documentation server in-process over an InMemoryTransport, one server per case, and replay recorded fixtures through the existing fetchImplementation seam. Each case carries its own fixture; the replay synthesizes the exact wire formats (Brave hits, Algolia hits, the OkHttp static index, DocC JSON, HTML, Markdown, YouTrack JSON) keyed by the request URLs the production provider logic computes, so the sanitizer, routing, allowlists, redirect and content-type checks, extraction, and ranking all run unmodified. RESEARCH_EVAL_LIVE=1 keeps a live mode for true retrieval-quality runs. Thread fetchImplementation through the Expo Algolia search so the recorded mode covers the expo provider, replace the sanitizer-broken kotlin-coroutines query with a symbol-anchored one, and run both evaluations in CI.
45 lines
917 B
YAML
45 lines
917 B
YAML
name: test
|
|
|
|
on:
|
|
push:
|
|
branches: [main]
|
|
pull_request:
|
|
|
|
permissions:
|
|
contents: read
|
|
|
|
jobs:
|
|
test:
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 10
|
|
steps:
|
|
- uses: actions/checkout@fbc6f3992d24b796d5a048ff273f7fcc4a7b6c09 # v5
|
|
|
|
- name: Set up Bun
|
|
uses: oven-sh/setup-bun@0c5077e51419868618aeaa5fe8019c62421857d6 # v2
|
|
with:
|
|
bun-version: latest
|
|
|
|
- name: Install dependencies
|
|
run: bun install --frozen-lockfile
|
|
|
|
- name: Lint
|
|
run: bun run lint
|
|
|
|
- name: Format check
|
|
run: bun run fmt:check
|
|
|
|
- name: Typecheck
|
|
run: bun run typecheck
|
|
|
|
- name: Build
|
|
run: bun run build
|
|
|
|
- name: Unit tests
|
|
run: bun test
|
|
|
|
- name: Research retrieval evaluation (recorded fixtures)
|
|
run: |
|
|
node scripts/research/evaluate-corpora.mjs
|
|
node scripts/research/evaluate-expo-prs.mjs
|