Compare commits

..
25 changed files with 93 additions and 998 deletions

No files matched your search

+1 -1
View File
@@ -32,7 +32,7 @@ This file describes the source layout and the rules that keep it in order.
| `cli` | Argument parsing, help, and the command handlers. | `args.ts`, `help.ts`, `*-commands.ts` |
| `map` | The local map store, build catalogs and comparisons, and the server for `expo-explore view`. | `store.ts`, `build-workspace.ts`, `compare.ts`, `viewer-server.ts` |
| `contracts` | The modules that `viewer/src` imports from `src/`, by value or by type: data shapes, validators and projections that the CLI and the Viewer share. `capture.ts` also defines the review types that the Viewer reads, such as `PublicReview`, and `review-validation.ts` validates them. | `capture.ts`, `review.ts`, `review-validation.ts`, `source-validation.ts` |
| `shared` | Small Node utilities that several folders use, and the pinned `agent-device` version that capture and review both check. | `ci-errors.ts`, `canonical-json.ts`, `bounded-bytes.ts`, `png-evidence.ts`, `agent-device-version.ts`, `timings.ts` (a capture job's timings and its summary, CI-FLOW §4.0) |
| `shared` | Small Node utilities that several folders use, and the pinned `agent-device` version that capture and review both check. | `ci-errors.ts`, `canonical-json.ts`, `bounded-bytes.ts`, `png-evidence.ts`, `agent-device-version.ts` |
## Dependency rule
+1 -11
View File
@@ -91,7 +91,7 @@ A failure at any stage is recorded in `state.failure`, a partial report is writt
Right after a merge, the next pull request's review starts while the baseline workflow is still capturing the new base: in brentvatne/euxy's review run 39348956443 it had started 15 s before, and every target captured its base too (10–14 minutes per target instead of about 6, on twice the EAS Simulator sessions). A baseline job takes 6–8 minutes and head capture 5–8, so `capture:review` waits for the baseline beside head instead of before it (`src/ci/baseline-wait.ts`):
1. The wait starts after preflight, only when `EXPLORE_BASELINE_RUN` names a run, no downloaded baseline matches, base has routes to capture, and `capture.baselineWaitMinutes` (default 15, 0 never waits) is not 0. Head starts capturing at once.
2. Every 20 s it reads the run (checked again by the same trust rules as `ci:find-baseline`), this target's artifact (`explore-baseline-<sha>-<target>`) in that run, and the run's jobs, logging `waiting for main's baseline run <id> of <sha> (<target>: in progress, in "<step>" for 2 min, 3 min)` once a minute or when the state changes, after one line with the run's link. The step is the one the baseline job is in: in brentvatne/euxy#179 a baseline sat 19 minutes installing ffmpeg while the line said only "in progress". When the state or the step changes, the sticky comment's line for the target says so too (`head 16/16 · base waits for the default branch's baseline (in "<step>")`), through a post that skips the PR check and never fails the review. Each read retries GitHub's 5xx and network failures (`retryGitHubLookup`).
2. Every 20 s it reads the run (checked again by the same trust rules as `ci:find-baseline`), this target's artifact (`explore-baseline-<sha>-<target>`) in that run, and the run's jobs, logging `waiting for main's baseline run <id> of <sha> (<target>: in progress, 3 min)` once a minute or when the state changes. Each read retries GitHub's 5xx and network failures (`retryGitHubLookup`).
3. When the artifact is listed, it is downloaded in-process (the token goes to GitHub, never to the storage URL it redirects to), unpacked into `<output>/baseline-download` within the cache's size limits, and restored as a downloaded baseline once head has its runtime profile. Another target's failed job does not matter; each target's job uploads its own artifact.
4. The wait ends without a baseline when this target's job fails, is cancelled or is skipped, the run ends without listing the artifact for a minute, the time runs out, GitHub refuses the token (`actions: read` missing) or keeps failing, or head fails. Base then captures at once, beside head when the sides capture concurrently. The wait never fails the review.
@@ -109,16 +109,6 @@ Head capture is never delayed. When the baseline arrives while head captures, ba
| 6 | route capture | Mode-specific (§5). `agent-device` drives the simulator and records a screenshot plus the accessibility tree. A capture is accepted only when the observer's reported destination matches the requested route. |
| 7 | `export` / `cleanup` | Validate the map, write `<side>-export/` (`bundle.json`, `execution.json`, PNGs, `capture-diagnostics/`), stop the session. |
### 4.0 Timings and heartbeats
Every capture job appends its timings to `$RUNNER_TEMP/explore-diagnostics/timings.jsonl` as it runs (`src/shared/timings.ts`). The diagnostics artifact already uploads that folder `if: always()`, so no workflow change is needed, and a job killed partway leaves what it did up to then.
- **Spans.** The review's and the baseline's phases (`controllers`, `plan`, `preflight`, `capture`, `compare`, `notes`, `report`). For each side and appearance pass: `configuration`, `fingerprint`, `build-lookup`, `native-build`, `repack`, `repack-share-wait`, `build-download`, `session-start` (from the request, beside the repack, to the session EAS hands over), `session-verify`, `install`, `launch`, each `route`, and `session-stop`. Spans overlap: head runs beside the baseline wait, and the session starts beside the repack.
- **The wait for a baseline.** `baseline-wait` is the whole wait, beside head; `baseline-blocked` is what it cost, from where base would have started to its end. The steps the baseline job finished, or was still in, are recorded as `baseline-step`.
- **What is written.** Phase names, ids, counts, durations and outcome codes; strings pass `safeText` (redacted, no links, one short line), and links are rebuilt from validated ids (`githubRunLink`, `easPageLink`), never copied from eas-cli's output. A simulator session's link is never written: sessions start with `--public-link`.
- **The summary.** The capture command appends a table to the job summary when it ends; `ci:after-capture` does for a capture stopped before it could.
- **Heartbeats.** A poll-driven wait prints when it starts and once a minute after: the baseline wait, the hosted repack (its state, time waited and budget left) and a shared repack being followed. A call that blocks its thread prints its bound first (`eas build --wait` 45 minutes, `workflow:run` 10, `build:download` 10, the app install 15). A side on a worker thread (sides captured at once, split appearance passes) has its parent print `head: still in install (3 min of at most 15 min)` once a minute while it is blocked; on the main thread nothing can run meanwhile.
### 4.1 The hosted repack: one budget, retries, and one repack per commit for a run's jobs
`prepareHostedRepack` (`src/capture/eas-build.ts`) runs the repack job. Three things keep it from failing a target, running long, or repeating work.
+2 -2
View File
@@ -1,12 +1,12 @@
{
"name": "@expo/explore",
"version": "0.22.0",
"version": "0.21.0",
"lockfileVersion": 3,
"requires": true,
"packages": {
"": {
"name": "@expo/explore",
"version": "0.22.0",
"version": "0.21.0",
"license": "MIT",
"dependencies": {
"@expo/repack-app": "0.10.1",
+1 -1
View File
@@ -1,6 +1,6 @@
{
"name": "@expo/explore",
"version": "0.22.0",
"version": "0.21.0",
"description": "Source-driven mobile app maps, deterministic CI capture, and visual reviews",
"license": "MIT",
"type": "module",
+11 -43
View File
@@ -6,7 +6,6 @@ import { setTimeout as delay } from "node:timers/promises";
import type { SourceRoute } from "../contracts/source-route.js";
import { CiError } from "../shared/ci-errors.js";
import { EXPLORE_VERSION } from "../shared/package-paths.js";
import { blockingCall, easPageLink, silentTimings, throttledProgress, type BlockingNotice, type Timings } from "../shared/timings.js";
import { prepareCaptureObserver, captureObserverParameterKeys } from "./observer.js";
import { isRecord, parseJson, nonEmpty } from "./common.js";
import { isWithin } from "./fs-safety.js";
@@ -455,8 +454,6 @@ export function hostedRepackRetries(error: unknown): number {
}
const EXPO_URL = /^https:\/\/expo\.dev\/\S+$/;
/** A workflow-run or build page eas-cli printed, rebuilt without any query or fragment it carried (easPageLink). */
const easLogLink = (value: string | undefined) => easPageLink(value, "workflows") ?? easPageLink(value, "builds");
const EAS_ID = /^[A-Za-z0-9-]{1,128}$/;
/**
@@ -464,7 +461,7 @@ const EAS_ID = /^[A-Za-z0-9-]{1,128}$/;
* error. `evidence` is the rest of what the run said: the CLI's stderr and the failed job's logs.
*/
export function hostedRepackBuildId(stdout: string, evidence: string, platform: "ios" | "android"): string {
let logs = easLogLink(/See logs: (https:\/\/expo\.dev\/\S+)/.exec(evidence)?.[1]);
let logs = /See logs: (https:\/\/expo\.dev\/\S+)/.exec(evidence)?.[1];
let value: unknown;
try {
value = parseJson(stdout, "eas workflow:run");
@@ -481,7 +478,7 @@ export function hostedRepackBuildId(stdout: string, evidence: string, platform:
}
for (const field of ["url", "logURL"]) {
const link = isRecord(value) ? value[field] : undefined;
if (typeof link === "string" && EXPO_URL.test(link)) logs = easLogLink(link) ?? logs;
if (typeof link === "string" && EXPO_URL.test(link)) logs = link;
}
const where = logs ? ` Logs: ${logs}` : "";
const jobs = isRecord(value) && Array.isArray(value.jobs) ? value.jobs.filter(isRecord) : [];
@@ -520,10 +517,8 @@ export function hostedRepackRunStart(stdout: string, stderr: string, platform: "
const printed = /See logs: (https:\/\/expo\.dev\/\S+)/.exec(stderr)?.[1];
let value: unknown;
try { value = JSON.parse(stdout); } catch { value = undefined; }
const printedUrl = isRecord(value) && typeof value.url === "string" && EXPO_URL.test(value.url) ? value.url : printed;
const id = isRecord(value) && typeof value.id === "string" ? value.id : printedUrl ? /\/workflows\/([^/?#\s]+)$/.exec(printedUrl)?.[1] : undefined;
// The link goes into logs, error messages and their diagnostics: only the page itself, never what eas-cli appended to it.
const url = easPageLink(printedUrl, "workflows");
const url = isRecord(value) && typeof value.url === "string" && EXPO_URL.test(value.url) ? value.url : printed;
const id = isRecord(value) && typeof value.id === "string" ? value.id : url ? /\/workflows\/([^/?#\s]+)$/.exec(url)?.[1] : undefined;
if (id && EAS_ID.test(id)) return { id, ...(url ? { url } : {}) };
const tail = stderr.trim().split("\n").slice(-3).join(" | ").slice(0, 600);
throw new CiError({ code: "EAS_REPACK_FAILED", stage: "instrumentation",
@@ -595,17 +590,12 @@ function printedBy(error: unknown): { stdout: string; stderr: string } {
* followed by another. A start that timed out or was stopped is waited on when it printed its run, and otherwise
* not replaced, since it may have started one.
*/
async function hostedRepackRun(options: { eas: EasCall; staged: string; platform: "ios" | "android"; clock: RepackClock;
say: (message: string) => void; onBlocking?: BlockingNotice | undefined }): Promise<string> {
async function hostedRepackRun(options: { eas: EasCall; staged: string; platform: "ios" | "android"; clock: RepackClock }): Promise<string> {
const { clock, platform } = options;
let started: { stdout: string; stderr: string };
let startFailure: unknown;
const startMs = Math.min(10 * 60_000, clock.deadline - clock.now());
options.say(`uploading the project and starting the hosted EAS repack (up to ${Math.ceil(startMs / 60_000)} minutes)`);
const uploaded = options.onBlocking?.("repack", startMs);
try { started = options.eas(["workflow:run", HOSTED_REPACK_WORKFLOW, "--json", "--non-interactive"], startMs, { cwd: options.staged }); }
try { started = options.eas(["workflow:run", HOSTED_REPACK_WORKFLOW, "--json", "--non-interactive"], Math.min(10 * 60_000, clock.deadline - clock.now()), { cwd: options.staged }); }
catch (error) { started = printedBy(error); startFailure = error; }
finally { uploaded?.(); }
let run: { id: string; url?: string };
try { run = hostedRepackRunStart(started.stdout, started.stderr, platform); }
catch (error) {
@@ -618,10 +608,6 @@ async function hostedRepackRun(options: { eas: EasCall; staged: string; platform
const cancel = (): boolean => {
try { options.eas(["workflow:cancel", run.id, "--non-interactive"], 2 * 60_000, { strict: true }); return true; } catch { return false; }
};
options.say(`waiting for the hosted EAS repack ${run.id}${run.url ? `: ${run.url}` : ""}`);
const waitedFrom = clock.now();
// Once a minute: the run's state, how long it has run and how long the capture still gives it.
const tick = throttledProgress(options.say, { now: clock.now });
try {
let unreadable = 0;
for (;;) {
@@ -640,8 +626,6 @@ async function hostedRepackRun(options: { eas: EasCall; staged: string; platform
}
return hostedRepackBuildId(view.stdout, `${started.stderr}\n${logs}`, platform);
}
tick(`hosted EAS repack ${run.id}: ${status && /^[A-Z_]{1,32}$/.test(status) ? status.toLowerCase().replaceAll("_", " ") : "state unreadable"}, `
+ `${Math.floor((clock.now() - waitedFrom) / 60_000)} min, ${Math.max(0, Math.floor((clock.deadline - clock.now()) / 60_000))} min left`);
unreadable = status ? 0 : unreadable + 1;
if (unreadable >= HOSTED_REPACK_UNREADABLE_READS) {
const cancelled = cancel();
@@ -798,8 +782,6 @@ async function sharedHostedRepack(options: { share: RepackShare; marker: string;
const setAside = new Set<string>();
let unreadable = 0;
let announced = false;
// When the followed repack last had a line: one a minute while it runs, as the repack this job waits on has.
let beat = 0;
for (;;) {
clock.signal?.throwIfAborted();
let read: ListedBuild[] | null | undefined;
@@ -828,7 +810,6 @@ async function sharedHostedRepack(options: { share: RepackShare; marker: string;
lookUntil = Math.min(clock.now() + sharedRepackWaitMs(options.share, true), lookLatest);
} else if (!followed && live) {
followed = live.id;
beat = clock.now();
say(`waiting for EAS build ${live.id}, the hosted repack of this commit another target of this run started, instead of repacking it again`);
}
}
@@ -846,10 +827,6 @@ async function sharedHostedRepack(options: { share: RepackShare; marker: string;
announced = true;
say(`waiting up to ${Math.round(firstWait / 60_000)} minutes for the hosted repack ${options.share.leader} or another target makes of this commit, instead of repacking it again`);
}
if (followed && now - beat >= 60_000) {
beat = now;
say(`waiting for EAS build ${followed}, the shared repack: ${Math.floor((now - start) / 60_000)} min, ${Math.max(0, Math.floor((clock.deadline - now) / 60_000))} min left`);
}
const until = followed ? clock.deadline : lookUntil;
await pause(Math.max(0, Math.min(followed ? SHARED_REPACK_FOLLOW_POLL_MS : SHARED_REPACK_APPEAR_POLL_MS, until - now)), clock);
}
@@ -880,8 +857,6 @@ async function prepareHostedRepack(options: {
share?: RepackShare | undefined;
say: (message: string) => void;
clock: RepackClock;
timings: Timings;
onBlocking?: BlockingNotice | undefined;
}): Promise<string> {
const { clock, platform } = options;
const staged = join(options.root, "project");
@@ -932,9 +907,9 @@ async function prepareHostedRepack(options: {
// The digest is taken before the workflow file is written: the file's message carries the key made from it.
const marker = hostedRepackShareMarker(hostedRepackShareKey({ scope: options.share.scope, platform, nativeBuildId: options.nativeBuildId,
easProfile: options.easProfile, environment, environmentVariables: variables, project: await stagedProjectDigest(staged) }));
const shared = await options.timings.measure("repack-share-wait", () => sharedHostedRepack({ share: options.share!, marker, platform, say: options.say, clock,
const shared = await sharedHostedRepack({ share: options.share, marker, platform, say: options.say, clock,
list: () => eas(["build:list", "--platform", platform, "--limit", String(SHARED_REPACK_LIST_LIMIT), "--json", "--non-interactive"], 2 * 60_000).stdout,
view: id => eas(["build:view", id, "--json"], 2 * 60_000).stdout }));
view: id => eas(["build:view", id, "--json"], 2 * 60_000).stdout });
if (shared) return shared;
message = `${message} ${marker}`;
}
@@ -947,8 +922,7 @@ async function prepareHostedRepack(options: {
for (;;) {
if (clock.deadline - clock.now() < HOSTED_REPACK_MIN_ATTEMPT_MS) throw timeoutError(platform, retries ? "too little time was left for another repack" : "too little time was left for a repack of its own");
try {
return await options.timings.measure("repack", () => hostedRepackRun({ eas, staged, platform, clock, say: options.say, onBlocking: options.onBlocking }),
{ attempt: retries + 1 });
return await hostedRepackRun({ eas, staged, platform, clock });
} catch (error) {
// Only a run EAS reported finished gets here with a failure that earns another (hostedRepackRun), so none is left beside it.
const allowed = hostedRepackRetries(error);
@@ -995,10 +969,6 @@ export async function prepareExactSourceBuild(options: {
now?: (() => number) | undefined;
sleep?: ((milliseconds: number) => void) | undefined;
signal?: AbortSignal | undefined;
/** Records the repack, the wait for another job's, and the download. */
timings?: Timings | undefined;
/** Told before a synchronous call blocks for minutes (CiMapOptions.onBlocking). */
onBlocking?: BlockingNotice | undefined;
}): Promise<PreparedBuild | undefined> {
const platform = options.platform ?? "ios";
const root = await mkdtemp(join(tmpdir(), "expo-explore-repack-"));
@@ -1015,14 +985,12 @@ export async function prepareExactSourceBuild(options: {
nativeBuildId: options.nativeBuildId, easProfile: options.easProfile, repackProfile: options.repackProfile,
easEnvironment: options.easEnvironment, restrictedEnvironment: options.repackEnvironment, provider: providers[0]!,
parameterKeys: captureObserverParameterKeys(options.routes), root, share: options.share, say: options.progress ?? (() => undefined),
timings: options.timings ?? silentTimings, onBlocking: options.onBlocking,
clock: { deadline: options.deadline ?? (options.now ?? Date.now)() + HOSTED_REPACK_BUDGET_MS, now: options.now ?? Date.now, sleep: options.sleep, signal: options.signal } });
{
// The hosted job leaves its app on EAS; the capture installs a copy downloaded here.
options.progress?.(`downloading the repacked app, EAS build ${hosted} (up to 10 minutes)`);
const downloaded = await downloadedAppPath(blockingCall(options.timings ?? silentTimings, options.onBlocking, "build-download", 10 * 60_000, () => options.runner({ command: options.easCommand,
const downloaded = await downloadedAppPath(options.runner({ command: options.easCommand,
args: ["build:download", "--build-id", hosted, "--json", "--non-interactive"], cwd: options.project,
environment: { ...options.easEnvironment, TMPDIR: root, TMP: root, TEMP: root }, timeoutMs: 10 * 60_000 })).stdout, root, platform);
environment: { ...options.easEnvironment, TMPDIR: root, TMP: root, TEMP: root }, timeoutMs: 10 * 60_000 }).stdout, root, platform);
await rename(downloaded, options.keepApp);
outcome = { buildId: hosted, app: options.keepApp };
}
+1 -8
View File
@@ -15,7 +15,6 @@ import type { SourceRoute } from "../contracts/source-route.js";
import { CiError, serializeCiError, toCiError } from "../shared/ci-errors.js";
import { type CaptureSetupSnapshot, credentialSavePromptDecline, describeSetupAction, executeCaptureSetup, isUnreadableSystemSurface, setupReadinessHolds } from "./setup-actions.js";
import { silentProgress } from "../shared/progress.js";
import { silentTimings, type Timings } from "../shared/timings.js";
import type { CaptureSetupReady } from "../config/explore-config.js";
import { READINESS_POLL_MS, defaultReadinessSeconds } from "./readiness.js";
import { KEYBOARD_POLL_MS, keyboardSettle, type KeyboardRead, type KeyboardSettle } from "./keyboard.js";
@@ -177,8 +176,6 @@ export async function capturePlannedRoutes(options: {
outcomes?: CaptureBundle["outcomes"];
/** Set when the review captures several appearances: the primary scheme keeps the route's screen id. */
appearance?: { scheme: ColorScheme; primary: boolean };
/** Records each route's span, from its first open to its outcome. */
timings?: Timings;
}): Promise<NonNullable<CaptureBundle["outcomes"]>> {
const screenIdFor = (routeId: string) => schemeScreenId(routeId, options.appearance && !options.appearance.primary ? options.appearance.scheme : undefined);
const colorScheme = options.appearance?.scheme;
@@ -1143,9 +1140,7 @@ export async function capturePlannedRoutes(options: {
const route = options.routes.find(route => outcomes[route.id]?.status !== "captured"
&& captureDestinationMatches(destination, route, inventory));
if (!route) return;
const endRoute = (options.timings ?? silentTimings).span("route", { route: route.route, via: "setup" });
try { await capturePreparedTarget(route, action.ready, current.nodes); }
finally { endRoute(outcomes[route.id]?.status === "captured" ? "ok" : "failed", { status: outcomes[route.id]?.status ?? "none" }); }
await capturePreparedTarget(route, action.ready, current.nodes);
reportOutcome(route, `after setup step ${index + 1}`);
},
});
@@ -1262,7 +1257,6 @@ export async function capturePlannedRoutes(options: {
continue;
}
attempted.add(route.id);
const endRoute = (options.timings ?? silentTimings).span("route", { route: route.route });
timingPhase = `route ${route.route}`;
say(`route ${++opened}/${linked.length} ${route.route}: opening by app link`);
for (let attempt = 1; attempt <= 2; attempt++) {
@@ -1311,7 +1305,6 @@ export async function capturePlannedRoutes(options: {
}
const outcome = outcomes[route.id];
if (setupIncomplete && outcome?.status === "captured") outcomes[route.id] = { ...outcome, reason: outcome.reason ? `${outcome.reason} ${setupIncomplete}` : setupIncomplete };
endRoute(outcome?.status === "captured" ? "ok" : "failed", { status: outcome?.status ?? "none" });
reportOutcome(route, "by app link");
}
return outcomes;
+24 -48
View File
@@ -21,7 +21,6 @@ import { lstatIfExists, isWithin, temporaryCaptureDirectory, absoluteContractFil
import { loadAppIcon, loadCachedAppIcon, storeAppIcon } from "./app-icon.js";
import { defaultRunner, runAgentControllerCommand } from "./controller.js";
import { silentProgress, type Progress } from "../shared/progress.js";
import { blockingCall, createTimings, phaseSequence, type BlockingNotice, type Timings } from "../shared/timings.js";
import { assertCaptureEasProfile, assertSimulatorAvailable, fingerprintFrom, hasEasEnvironmentFetchFailure, nativeBuildFrom, existingBuild, repackProfileFrom, prepareExactSourceBuild, HOSTED_REPACK_BUDGET_MS, type RepackMode, type RepackShare } from "./eas-build.js";
import { SIMULATOR_DOTENV_FILE_NAME, SIMULATOR_DOTENV_HEADER, endedOwnSimulatorSession, liveSimulatorSessionsNamed, simulatorSessionName, simulatorStartFailure, readSimulatorDotenvHandoff, assertSimulatorSessionIdentity, assertSimulatorStopped, collectRuntime, controllerVersion, simulatorOsVersion, type ActiveSimulatorRuntime, type SimulatorConnection } from "./simulator.js";
import { argentControllerInvocation } from "./controller-invocation.js";
@@ -92,11 +91,6 @@ export type CiMapOptions = {
readinessSeconds?: number;
/** Reports each step as it starts; capture output stays in the map and bundle. */
progress?: Progress;
/** Where this capture appends its timings (timings.jsonl), labelled with `timingsSide` or else `side`. A path crosses to a worker thread; a recorder could not. */
timingsPath?: string;
timingsSide?: string;
/** Told before a synchronous call blocks this thread for minutes: a worker's parent prints while it is (runCiMapOnWorker). */
onBlocking?: BlockingNotice;
/** Stops the capture between steps (before the build, the session and each route); a session it started is still stopped. */
signal?: AbortSignal;
};
@@ -197,20 +191,16 @@ export function revisionSetup(setup: readonly CaptureSetupStep[], plan: SourceCa
/** Source-plan capture. App state is observed as it runs; optional agents cannot change the inventory. */
export async function runCiMap(input: Omit<CiMapOptions, "platform"> & { platform?: Platform }): Promise<CiMapResult> {
const options: CiMapOptions = { ...input, platform: input.platform ?? "ios" };
const timings = createTimings({ path: options.timingsPath, labels: { side: options.timingsSide ?? options.side, pass: options.appearancePass?.capture.join("+") },
secrets: [options.expoToken, ...environmentSecrets(options.environment ?? process.env)] });
let stage = "preflight";
return timings.measure("pass", async () => {
try { return await executeCiMap(options, value => { stage = value; }, timings); }
catch (error) {
throw toCiError(error, { code: `CAPTURE_${stage.toUpperCase().replace(/-/g, "_")}_FAILED`, stage,
nextAction: stage === "cleanup" ? "Stop the exact session identified in the session handoff, then retry."
: "Inspect the capture diagnostic, correct the failing prerequisite, and rerun Explore." });
}
});
try { return await executeCiMap(options, value => { stage = value; }); }
catch (error) {
throw toCiError(error, { code: `CAPTURE_${stage.toUpperCase().replace(/-/g, "_")}_FAILED`, stage,
nextAction: stage === "cleanup" ? "Stop the exact session identified in the session handoff, then retry."
: "Inspect the capture diagnostic, correct the failing prerequisite, and rerun Explore." });
}
}
async function executeCiMap(options: CiMapOptions, setStage: (stage: string) => void, timings: Timings): Promise<CiMapResult> {
async function executeCiMap(options: CiMapOptions, setStage: (stage: string) => void): Promise<CiMapResult> {
if (!options.confirmExternalRun || !options.confirmTrustedSource) throw new Error("EAS capture requires authorized external execution of the selected source commit.");
positiveInteger(options.maxScreens, "maxScreens");
positiveInteger(options.maxActions, "maxActions");
@@ -475,7 +465,7 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
const controlOptions = { sleep: options.sleep };
// What the EAS session's host can do through simulator:control (iOS sessions on serve-sim 0.10.0 or later).
let controlActions = new Set<string>();
const configResult = timings.measure("configuration", () => eas(["config", "--platform", options.platform, "--profile", options.easProfile, "--json", "--non-interactive"]));
const configResult = eas(["config", "--platform", options.platform, "--profile", options.easProfile, "--json", "--non-interactive"]);
const profile = repackProfileFrom(configResult.stdout);
const configValue = parseJson(configResult.stdout, "eas config") as { appConfig: Record<string, unknown>; buildProfile: Record<string, unknown> };
scheme ??= appScheme(configValue.appConfig.scheme);
@@ -580,8 +570,6 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
if (local || sessionStart) return;
if (!retry) say(`starting an EAS Simulator session (${options.device}) while the app is repacked`);
sessionStartedAt = (options.now ?? Date.now)();
// From the request to the session EAS hands over, beside the repack: the queue and boot time of the session.
const started = timings.span("session-start", { attempt: sessionRetries });
const request = (minutes: number) => ({ command: options.easCommand, args: ["simulator:start", "--name", sessionName, "--platform", options.platform, "--device", options.device,
"--type", controller, "--package-version", controllerVersion(controller), "--public-link",
"--max-duration-minutes", String(minutes), "--out-config-type", "dotenv", "--non-interactive"], cwd: simulatorProject, environment: easEnvironment,
@@ -596,8 +584,7 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
say(`EAS allows ${limit}-minute sessions on this plan; starting the session again without the full repack allowance`);
return start(Math.max(options.maxDurationMinutes, limit));
}))
.then(() => undefined, (error: unknown) => error)
.then(error => { started(error ? "failed" : "ok"); return error; });
.then(() => undefined, (error: unknown) => error);
};
setStage("build");
// The instrumented app stays on this machine: a local device installs it, and an EAS session gets it through the
@@ -609,17 +596,17 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
// What a hosted repack waits with and reports through: one deadline from the moment the session starts beside it, for
// the wait for another job's repack and every repack of its own. The repack is shared with this run's other matrix
// jobs only when it repacks a build EAS already had: a native build this job made is its own, so nobody else's key matches it.
const repackWaits = (shared: boolean) => ({ ...(shared ? { share: options.repackShare } : {}), progress: say, now: options.now, sleep: options.sleep, timings, onBlocking: options.onBlocking,
const repackWaits = (shared: boolean) => ({ ...(shared ? { share: options.repackShare } : {}), progress: say, now: options.now, sleep: options.sleep,
signal: options.signal, deadline: (options.now ?? Date.now)() + HOSTED_REPACK_BUDGET_MS });
// `repacking` tells the captures sharing this build that their sessions can start too (sharedBuild).
const buildApp = async (keepApp: string, repacking?: () => Promise<void>): Promise<BuiltApp> => {
options.signal?.throwIfAborted();
say("computing the native fingerprint");
const fingerprintResult = timings.measure("fingerprint", () => eas(["fingerprint:generate", "--platform", options.platform, "--build-profile", options.easProfile, "--json", "--non-interactive"]));
const fingerprintResult = eas(["fingerprint:generate", "--platform", options.platform, "--build-profile", options.easProfile, "--json", "--non-interactive"]);
const sourceFingerprint = fingerprintFrom(fingerprintResult.stdout);
const reusable = options.forceFreshBuild || hasEasEnvironmentFetchFailure(configResult.stderr) || hasEasEnvironmentFetchFailure(fingerprintResult.stderr)
? undefined : existingBuild(timings.measure("build-lookup", () => eas(["build:list", "--platform", options.platform, "--status", "finished", "--build-profile", options.easProfile,
"--fingerprint-hash", sourceFingerprint, ...(options.platform === "ios" ? ["--simulator"] : []), "--limit", "20", "--json", "--non-interactive"])).stdout);
? undefined : existingBuild(eas(["build:list", "--platform", options.platform, "--status", "finished", "--build-profile", options.easProfile,
"--fingerprint-hash", sourceFingerprint, ...(options.platform === "ios" ? ["--simulator"] : []), "--limit", "20", "--json", "--non-interactive"]).stdout);
if (reusable) {
say(`reusing EAS build ${reusable.id} (fingerprint ${sourceFingerprint.slice(0, 12)}); repacking it with this commit's JavaScript and the route observer`);
startSession(); await repacking?.();
@@ -632,10 +619,9 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
...(reusable.appVersion ? { version: reusable.appVersion } : {}), ...(reusable.appBuildVersion ? { buildNumber: reusable.appBuildVersion } : {}) };
}
options.signal?.throwIfAborted();
say(options.forceFreshBuild ? "building on EAS (a fresh build was requested); waiting up to 45 minutes for it to finish"
: `no finished simulator build has fingerprint ${sourceFingerprint.slice(0, 12)}; building on EAS and waiting up to 45 minutes for it to finish`);
const built = nativeBuildFrom(blockingCall(timings, options.onBlocking, "native-build", 45 * 60_000,
() => eas(["build", "--platform", options.platform, "--profile", options.easProfile, "--wait", "--json", "--non-interactive"], 45 * 60_000)).stdout);
say(options.forceFreshBuild ? "building on EAS (a fresh build was requested); waiting for it to finish"
: `no finished simulator build has fingerprint ${sourceFingerprint.slice(0, 12)}; building on EAS and waiting for it to finish`);
const built = nativeBuildFrom(eas(["build", "--platform", options.platform, "--profile", options.easProfile, "--wait", "--json", "--non-interactive"], 45 * 60_000).stdout);
say(`EAS build ${built.id} finished; repacking it with the route observer`);
startSession(); await repacking?.();
const repacked = await prepareExactSourceBuild({ platform: options.platform, runner, easCommand: options.easCommand, repackCommand: options.repackCommand,
@@ -688,11 +674,8 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
}
let primaryError: unknown;
let runtimeStage = "session";
// The session's handover and the app's install, in turn; the passes after them have spans of their own.
const runtimePhases = phaseSequence(timings);
try {
setStage(runtimeStage);
runtimePhases.enter("session-verify");
let connection: SimulatorConnection | undefined;
if (localApp && localEmulator && localEmulatorStart) {
await assertLocalEmulatorCompatible(localApp, hostEmulatorAbi());
@@ -831,7 +814,6 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
outcomes[schemeScreenId(id, scheme)] = { status: "failed", attempts: 0, landing: "unverified", reason: error.message, error };
}
// The finally block below stops the session after the export.
runtimePhases.end("skipped");
return await finish();
}
}
@@ -863,10 +845,9 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
}
if (!local && localApp) {
// The session started empty while the app was repacked; the controller installs it now.
say(`installing the app on session ${sessionId} (up to 15 minutes)`);
runtimePhases.end();
blockingCall(timings, options.onBlocking, "install", 15 * 60_000, () => runner({ command: controllerCommand, args: ["install", localApp, "--session", CONTROLLER_SESSION,
...deviceArgs({ platform: options.platform, deviceModel: options.device }), "--platform", options.platform, "--json"], cwd: simulatorProject, environment: controllerEnvironment, timeoutMs: 15 * 60_000 }));
say(`installing the app on session ${sessionId}`);
runner({ command: controllerCommand, args: ["install", localApp, "--session", CONTROLLER_SESSION, ...deviceArgs({ platform: options.platform, deviceModel: options.device }),
"--platform", options.platform, "--json"], cwd: simulatorProject, environment: controllerEnvironment, timeoutMs: 15 * 60_000 });
// Before any link opens, as a local capture does with simctl: the app's own links then open without the prompt.
if (sessionId && scheme) {
const approved = approveSessionUrlSchemes(sessionEas, sessionId, controlActions, options.bundleId, [scheme], controlOptions);
@@ -1027,13 +1008,10 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
const recordingTools = launchSetting === "off" ? undefined : options.recordingTools === undefined ? ffmpegRecordingTools() : options.recordingTools ?? undefined;
const capturedSchemes = options.appearancePass ? colorSchemes.filter(scheme => options.appearancePass!.capture.includes(scheme)) : colorSchemes;
const activeRuntime = runtime;
runtimePhases.end();
for (const [index, colorScheme] of colorSchemes.entries()) {
// A pass another session makes leaves its slot empty, so the passes stay aligned with the appearances they merge by.
if (!capturedSchemes.includes(colorScheme)) { passes.push({}); continue; }
const passOutcomes: CaptureBundle["outcomes"] = index === 0 ? outcomes : {};
// Each appearance's launch and routes are labelled with it, also when one session captures them in turn.
const passTimings = colorSchemes.length > 1 ? timings.labelled({ pass: colorScheme }) : timings;
const capturePass = async () => {
// Argent cannot switch the appearance yet (software-mansion/argent#1509): the host does, simctl or adb on this
// machine and serve-sim on an EAS iOS session; elsewhere its single pass runs as the device starts.
@@ -1049,12 +1027,11 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
say(`observing the app launch${colorSchemes.length > 1 ? ` (${colorScheme})` : ""}`);
try {
// A restored baseline's launch evidence is replaced only by a fresh observation.
const record = await passTimings.measure("launch", () => captureLaunch({ bundleId: options.bundleId, keepVideo: launchSetting === "video", platform: options.platform,
const record = await captureLaunch({ bundleId: options.bundleId, keepVideo: launchSetting === "video", platform: options.platform,
directory: join(launchWorkDirectory, launchDirectory(colorScheme)), relativeDirectory: launchDirectory(colorScheme), ...(options.now ? { now: options.now } : {}),
...(recordingTools ? { recordingTools } : {}),
controller: (args, controllerOptions) => runner({ command: controllerCommand, args: [...args, "--session", CONTROLLER_SESSION, ...deviceArgs(activeRuntime), "--platform", options.platform],
cwd: simulatorProject, environment: controllerEnvironment, timeoutMs: controllerOptions?.timeoutMs ?? 60_000, ...(controllerOptions?.allowFailure ? { allowFailure: true } : {}) }) }),
{ scheme: colorScheme });
cwd: simulatorProject, environment: controllerEnvironment, timeoutMs: controllerOptions?.timeoutMs ?? 60_000, ...(controllerOptions?.allowFailure ? { allowFailure: true } : {}) }) });
launch[colorScheme] = { root: launchWorkDirectory, record };
} catch (error) {
// The launch is supplementary evidence: a failure to observe it leaves the route capture intact.
@@ -1066,7 +1043,7 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
activeRuntime.colorScheme = colorScheme;
if (colorSchemes.length > 1) say(`appearance ${colorScheme} (${index + 1}/${colorSchemes.length})`);
return await capturePlannedRoutes({ capture: { ...options, ...(argentBridge && !options.agent ? { runner: argentBridge.runner } : {}), agentDeviceCommand: controllerCommand, setup, progress: say }, routes: missingRoutes, inventory, scheme, appName: app.name, runtime: activeRuntime,
connection, environment: controllerEnvironment, store, map, acceptedFrames, outcomes: passOutcomes, timings: passTimings,
connection, environment: controllerEnvironment, store, map, acceptedFrames, outcomes: passOutcomes,
...(colorSchemes.length > 1 ? { appearance: { scheme: colorScheme, primary: index === 0 } } : {}) });
};
// A later pass of a session whose primary pass captured fails only its own appearance, as a secondary session does
@@ -1097,7 +1074,7 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
const pass = passes[colorSchemes.indexOf(failedScheme)] ?? {};
for (const id of selectedIds) if (!pass[id]) outcomes[schemeScreenId(id, failedScheme)] = { status: "failed", attempts: 0, landing: "unverified", reason: error.message, error };
}
} catch (error) { runtimePhases.end("failed"); primaryError = toCiError(error, { code: `CAPTURE_${runtimeStage.toUpperCase()}_FAILED`, stage: runtimeStage,
} catch (error) { primaryError = toCiError(error, { code: `CAPTURE_${runtimeStage.toUpperCase()}_FAILED`, stage: runtimeStage,
nextAction: "Inspect the capture diagnostic, correct the failing prerequisite, and rerun Explore." }); }
finally {
if (appDirectory) await rm(appDirectory, { recursive: true, force: true });
@@ -1139,8 +1116,7 @@ async function executeCiMap(options: CiMapOptions, setStage: (stage: string) =>
try {
setStage("cleanup");
say(`stopping simulator session ${sessionId}`);
const stopping = sessionId;
assertSimulatorStopped(timings.measure("session-stop", () => eas(["simulator:stop", "--id", stopping, "--json", "--non-interactive"], 2 * 60_000)).stdout, stopping);
assertSimulatorStopped(eas(["simulator:stop", "--id", sessionId, "--json", "--non-interactive"], 2 * 60_000).stdout, sessionId);
if (statePath) await rm(statePath, { force: true });
await rm(simulatorProject, { recursive: true, force: true });
} catch (error) { throw new CiError({ code: "SESSION_CLEANUP_FAILED", stage: "cleanup",
+3 -53
View File
@@ -3,9 +3,8 @@ import { mkdir, mkdtemp, open, rm, writeFile } from "node:fs/promises";
import { dirname, join, relative, resolve } from "node:path";
import { setTimeout as delay } from "node:timers/promises";
import { BlobReader, Uint8ArrayWriter, ZipReader, configure } from "@zip.js/zip.js";
import { CiError, environmentSecrets } from "../shared/ci-errors.js";
import { CiError } from "../shared/ci-errors.js";
import { silentProgress, type Progress } from "../shared/progress.js";
import { githubRunLink, safeText, silentTimings, type Timings } from "../shared/timings.js";
import { retryGitHubLookup } from "../report/github-lookup.js";
import { safeRelativePath } from "../binary/archive.js";
import { CAPTURE_CACHE_MAX_BYTES, CAPTURE_CACHE_MAX_FILES } from "./artifact-cache.js";
@@ -27,11 +26,7 @@ const ARTIFACT_LISTING_GRACE_MS = 60_000;
/** A zip of the largest capture cache, stored rather than deflated, plus its headers. */
const MAX_ARTIFACT_ZIP_BYTES = CAPTURE_CACHE_MAX_BYTES + 16 * 1024 * 1024;
type GithubStep = { name?: string; number?: number; status?: string; conclusion?: string | null; started_at?: string | null; completed_at?: string | null };
type GithubJob = { name: string; status?: string; conclusion?: string | null; steps?: GithubStep[] };
/** What the review is waiting on, as it changes: the baseline job's state and the step it is in, from the same poll. */
export type BaselineWaitUpdate = { state: string; step?: string; stepSince?: number; waitedMs: number };
type GithubJob = { name: string; status?: string; conclusion?: string | null };
export type BaselineWaitOptions = {
/** The baseline run `ci:find-baseline` named; it is checked again here, by the same trust rules. */
@@ -40,10 +35,6 @@ export type BaselineWaitOptions = {
timeoutMs: number; pollMs?: number;
environment?: NodeJS.ProcessEnv; transport?: typeof fetch; progress?: Progress; signal?: AbortSignal;
now?: () => number; sleep?: (milliseconds: number, signal?: AbortSignal) => Promise<void>;
/** Called when the baseline job's state or step changes: the review's sticky comment says what it waits on. */
onUpdate?: (update: BaselineWaitUpdate) => void;
/** Records the wait, and the steps the baseline job finished (or was still in) while the review waited. */
timings?: Timings;
};
/** A failed GitHub read that may succeed later: no answer or a 5xx. A bad token or a missing permission is not. */
@@ -58,26 +49,7 @@ const statusText = (status: string | undefined) => (status ?? "queued").replaceA
* the time limit, a missing permission and GitHub failures that outlast their retries. The reason says which.
*/
export async function waitForBaselineArtifact(options: BaselineWaitOptions): Promise<{ artifact: { id: number; run: number } } | { reason: string }> {
const timings = options.timings ?? silentTimings;
const now = options.now ?? Date.now;
const end = timings.span("baseline-wait", { run: options.run });
// The step the baseline job was last seen in: when the wait ends there, it is recorded with the time it had taken so far.
const watch: BaselineWatch = { recorded: new Set() };
const outcome = await pollBaselineArtifact(options, watch);
if (watch.current) timings.record({ type: "baseline-step", name: watch.current.name, ms: Math.max(0, now() - watch.current.since), conclusion: "still running" });
end("artifact" in outcome ? "ok" : "skipped", "artifact" in outcome ? { result: "artifact" } : { result: "gave up", reason: outcome.reason });
return outcome;
}
type BaselineWatch = { recorded: Set<number>; current?: { name: string; since: number } };
/** A step's start or end as GitHub reports it, as a time on the wait's clock; GitHub's clock and the runner's agree to seconds. */
const stepTime = (value: string | null | undefined) => { const time = Date.parse(value ?? ""); return Number.isFinite(time) ? time : undefined; };
async function pollBaselineArtifact(options: BaselineWaitOptions, watch: BaselineWatch): Promise<{ artifact: { id: number; run: number } } | { reason: string }> {
const now = options.now ?? Date.now;
const timings = options.timings ?? silentTimings;
const secrets = environmentSecrets(options.environment ?? process.env);
const sleep = options.sleep ?? ((milliseconds: number, signal?: AbortSignal) => delay(milliseconds, undefined, signal ? { signal } : {}));
const progress = options.progress ?? silentProgress;
const started = now();
@@ -92,12 +64,9 @@ async function pollBaselineArtifact(options: BaselineWaitOptions, watch: Baselin
const jobNames = [`baseline (${target})`, ...(target === "ios" ? ["baseline"] : [])];
let finishedAt: number | undefined;
let logged = "";
let reported = "";
let link = githubRunLink(options.environment ?? process.env, options.run);
for (;;) {
const run = await get<GithubRun>(`repos/${context.repository}/actions/runs/${options.run}`);
if (!trustedBaselineRun(run, lookup)) return { reason: `run ${options.run} is not a baseline run of ${short} on ${lookup.defaultBranch}` };
if (link) { progress(`waiting for ${lookup.defaultBranch}'s baseline run ${run.id} of ${short}: ${link}`); link = undefined; }
for (const name of lookup.names) {
const listed = await get<{ artifacts?: GithubArtifact[] }>(`repos/${context.repository}/actions/runs/${run.id}/artifacts?name=${encodeURIComponent(name)}&per_page=100`);
const artifact = (listed?.artifacts ?? []).filter(candidate => !candidate.expired && (candidate.name ?? name) === name
@@ -106,18 +75,6 @@ async function pollBaselineArtifact(options: BaselineWaitOptions, watch: Baselin
}
const jobs = await get<{ jobs?: GithubJob[] }>(`repos/${context.repository}/actions/runs/${run.id}/jobs?per_page=100`);
const job = jobs?.jobs?.find(candidate => jobNames.includes(candidate.name));
// The job's steps say where it is: in brentvatne/euxy#179 a baseline sat 19 minutes installing ffmpeg while the
// review's line said only "in progress". Each finished step is recorded once; the one running is named.
for (const step of job?.steps ?? []) {
const started = stepTime(step.started_at), completed = stepTime(step.completed_at);
if (step.status !== "completed" || typeof step.number !== "number" || watch.recorded.has(step.number) || started === undefined || completed === undefined) continue;
watch.recorded.add(step.number);
timings.record({ type: "baseline-step", name: step.name ?? "?", ms: Math.max(0, completed - started), conclusion: step.conclusion ?? "unknown" });
}
const running = job?.status === "in_progress" ? job.steps?.find(step => step.status === "in_progress" && step.name) : undefined;
const since = stepTime(running?.started_at);
if (running && since !== undefined) watch.current = { name: running.name!, since };
else delete watch.current;
if (job?.status === "completed" && job.conclusion !== "success") {
return { reason: `its ${target} job ${job.conclusion === "cancelled" ? "was cancelled" : job.conclusion === "failure" ? "failed" : `ended (${job.conclusion ?? "no conclusion"})`}` };
}
@@ -129,15 +86,8 @@ async function pollBaselineArtifact(options: BaselineWaitOptions, watch: Baselin
const waited = now() - started;
const state = job ? statusText(job.status) : run.status === "completed" ? "finished" : "not started";
if (waited >= options.timeoutMs) return { reason: `its ${target} job is still ${state} after ${Math.round(waited / 60_000)} min` };
const step = watch.current ? safeText(watch.current.name, secrets) : undefined;
const update = `${state}\0${step ?? ""}`;
if (update !== reported) {
reported = update;
options.onUpdate?.({ state, ...(step && watch.current ? { step, stepSince: watch.current.since } : {}), waitedMs: waited });
}
// A line when the state changes and once a minute, not on every poll.
const where = step && watch.current ? `, in "${step}" for ${Math.max(0, Math.floor((now() - watch.current.since) / 60_000))} min` : "";
const line = `waiting for ${lookup.defaultBranch}'s baseline run ${run.id} of ${short} (${target}: ${state}${where}, ${Math.floor(waited / 60_000)} min)`;
const line = `waiting for ${lookup.defaultBranch}'s baseline run ${run.id} of ${short} (${target}: ${state}, ${Math.floor(waited / 60_000)} min)`;
if (line !== logged) { progress(line); logged = line; }
await sleep(Math.min(options.pollMs ?? POLL_MS, options.timeoutMs - waited), options.signal);
}
+5 -35
View File
@@ -2,40 +2,18 @@ import { Worker, isMainThread, parentPort, workerData } from "node:worker_thread
import { runCiMap, type CiMapOptions, type CiMapResult } from "../capture/run.js";
import { CiError, environmentSecrets, serializeCiError, type CiErrorData } from "../shared/ci-errors.js";
import type { Progress } from "../shared/progress.js";
import { TIMING_PHASES, formatDuration, type TimingPhase } from "../shared/timings.js";
type WorkerMessage = { type: "progress"; message: string } | { type: "done"; result: CiMapResult } | { type: "error"; error: CiErrorData }
| { type: "blocking"; phase: TimingPhase; boundMs: number } | { type: "unblocked" };
type WorkerMessage = { type: "progress"; message: string } | { type: "done"; result: CiMapResult } | { type: "error"; error: CiErrorData };
/** From the parent: stop between steps, as `signal` does for a capture on the main thread. */
type ParentMessage = { type: "abort"; reason: CiErrorData };
/** Options a worker can receive: the controller runs through synchronous subprocesses, so a side only overlaps another from its own thread. */
export type CaptureWorkerOptions = Omit<CiMapOptions, "progress" | "runner" | "now" | "fetch" | "agent" | "signal" | "onBlocking">;
export type CaptureWorkerOptions = Omit<CiMapOptions, "progress" | "runner" | "now" | "fetch" | "agent" | "signal">;
/**
* Run one capture side on a worker thread so head and base can drive their simulator sessions at the same time. While
* the worker is blocked in a synchronous call it named (a native build, an install), this thread is free and says so
* every `heartbeatMs`: the worker itself can print nothing until the call returns.
*/
/** Run one capture side on a worker thread so head and base can drive their simulator sessions at the same time. */
export function runCiMapOnWorker(options: CaptureWorkerOptions, progress: Progress, signal?: AbortSignal): Promise<CiMapResult> {
return settleCaptureWorker(new Worker(new URL("./capture-worker.js", import.meta.url), { workerData: options }), options, progress, signal);
}
/** The parent's side of a capture worker: its messages, its heartbeat while blocked, and how it ends. Tests drive it with a stub worker. */
export function settleCaptureWorker(worker: Worker, options: Pick<CaptureWorkerOptions, "side" | "timingsSide" | "appearancePass">, progress: Progress,
signal?: AbortSignal, heartbeatMs = 60_000): Promise<CiMapResult> {
return new Promise((resolve, reject) => {
let heartbeat: ReturnType<typeof setInterval> | undefined;
const unblocked = () => { clearInterval(heartbeat); heartbeat = undefined; };
const blocked = (phase: TimingPhase, boundMs: number) => {
unblocked();
const since = Date.now();
// Named as the capture's timings are: a baseline captures its commit as head.
const who = [options.timingsSide ?? options.side ?? "capture", options.appearancePass?.capture.join("+")].filter(Boolean).join(" ");
heartbeat = setInterval(() => progress(`${who}: still in ${phase} (${formatDuration(Date.now() - since)} of at most ${formatDuration(boundMs)})`), heartbeatMs);
heartbeat.unref();
};
worker.once("exit", unblocked);
const worker = new Worker(new URL("./capture-worker.js", import.meta.url), { workerData: options });
// An AbortSignal cannot cross threads; the worker aborts its own, and its capture stops its session as usual.
const abort = () => worker.postMessage({ type: "abort", reason: serializeCiError(signal!.reason) } satisfies ParentMessage);
if (signal?.aborted) abort(); else signal?.addEventListener("abort", abort, { once: true });
@@ -43,9 +21,6 @@ export function settleCaptureWorker(worker: Worker, options: Pick<CaptureWorkerO
let settled = false;
const finish = (callback: () => void) => { if (!settled) { settled = true; callback(); } };
worker.on("message", (message: WorkerMessage) => {
// Handled before the catch-all below, which settles the capture as failed on any message it does not know.
if (message.type === "blocking") { if (TIMING_PHASES.includes(message.phase)) blocked(message.phase, message.boundMs); return; }
if (message.type === "unblocked") { unblocked(); return; }
if (message.type === "progress") progress(message.message);
else if (message.type === "done") finish(() => resolve(message.result));
else finish(() => reject(new CiError({ ...message.error, ...(message.error.details ? { details: message.error.details } : {}) })));
@@ -64,12 +39,7 @@ if (!isMainThread && parentPort) {
port.on("message", (message: ParentMessage) => { if (message.type === "abort") controller.abort(new CiError(message.reason)); });
// Listening for an abort must not keep the worker alive once its capture is done.
port.unref();
runCiMap({ ...options, signal: controller.signal, progress: message => port.postMessage({ type: "progress", message } satisfies WorkerMessage),
// Posted before the call blocks this thread: the parent receives it while the call runs.
onBlocking: (phase, boundMs) => {
port.postMessage({ type: "blocking", phase, boundMs } satisfies WorkerMessage);
return () => port.postMessage({ type: "unblocked" } satisfies WorkerMessage);
} })
runCiMap({ ...options, signal: controller.signal, progress: message => port.postMessage({ type: "progress", message } satisfies WorkerMessage) })
.then(result => port.postMessage({ type: "done", result } satisfies WorkerMessage))
.catch((error: unknown) => port.postMessage({ type: "error", error: serializeCiError(error, { secrets: [options.expoToken, ...environmentSecrets(options.environment ?? {})] }) } satisfies WorkerMessage));
}
+21 -116
View File
@@ -19,7 +19,7 @@ import { quarantineReviewContract } from "../contracts/review-validation.js";
import { agentCaptureConstraints } from "../capture/agent/source-context.js";
import { captureArtifactCacheMayMatch, captureRecipeConfig, incompleteCaptureReason, restoreCaptureArtifactCache, writeCaptureArtifactCache } from "./artifact-cache.js";
import { runCiMapOnWorker } from "./capture-worker.js";
import { DEFAULT_BASELINE_WAIT_MINUTES, awaitPendingBaseline, type BaselineWaitOptions } from "./baseline-wait.js";
import { DEFAULT_BASELINE_WAIT_MINUTES, awaitPendingBaseline } from "./baseline-wait.js";
import { writeCiReportInput, readAppDirectory } from "../report/artifact.js";
import { assessPublicEvidence, readExportedMap, type PublicEvidenceSide } from "../review/evidence-assessment.js";
import { parseRuntimeExecutionContext } from "../review/runtime-adapter.js";
@@ -34,10 +34,9 @@ import { CiError, environmentSecrets, serializeCiError, toCiError } from "../sha
import type { SourceCapturePlan } from "../source/capture-plan.js";
import { createSourceChangeSummaries } from "../source/change-summary.js";
import { assertNoCaptureHealthIssues, capturedEvidenceInDoubt, partitionCaptureHealthIssues, renderCaptureIssueAnnotation, renderComparisonDiagnosticAnnotation, renderNotesUnavailableAnnotation, renderReviewGapAnnotation, sortedCaptureHealthIssues } from "../capture/health.js";
import { EXPLORE_PACKAGE, EXPLORE_VERSION, packageBin } from "../shared/package-paths.js";
import { EXPLORE_PACKAGE, packageBin } from "../shared/package-paths.js";
import { agentDeviceLauncher, ensureArgentToolServer, ensureController } from "../shared/controller-cache.js";
import { silentProgress, type Progress } from "../shared/progress.js";
import { createTimings, phaseSequence, silentTimings, type RecordedEvent, type Timings } from "../shared/timings.js";
function requireSecret(environment: NodeJS.ProcessEnv, name: string): string {
@@ -161,7 +160,7 @@ export async function captureSideInSessions(mapOptions: CiMapOptions, passes: re
progress: Progress, signal: AbortSignal | undefined, worker: boolean,
runPass?: (passOptions: CiMapOptions) => Promise<Awaited<ReturnType<typeof runCiMap>>>): Promise<Awaited<ReturnType<typeof runCiMap>>> {
const runOnWorker = runPass ?? ((passOptions: CiMapOptions) =>
runCiMapOnWorker((({ progress: _progress, runner: _runner, agent: _agent, signal: _signal, onBlocking: _onBlocking, ...rest }) => rest)(passOptions), progress, signal));
runCiMapOnWorker((({ progress: _progress, runner: _runner, agent: _agent, signal: _signal, ...rest }) => rest)(passOptions), progress, signal));
if (!passes || passes.length <= 1) return worker ? runOnWorker(mapOptions) : runCiMap(mapOptions);
const schemes = passes.flat();
progress(`${mapOptions.side}: capturing ${passes.map(pass => pass.join("+")).join(" and ")} in separate sessions`);
@@ -241,14 +240,11 @@ export async function sideAppearancePasses(config: ExploreConfig, environment: N
* base is never started for a review that has already failed.
*/
export async function captureBaseAfterWait(input: { waited: Promise<string | undefined> | undefined; head: Promise<void>; stopWaiting: () => void;
captureBase: (cacheDirectory?: string) => Promise<void>; timings?: Timings }): Promise<void> {
captureBase: (cacheDirectory?: string) => Promise<void> }): Promise<void> {
if (!input.waited) return input.captureBase();
let headFailed = false;
input.head.catch(() => { headFailed = true; input.stopWaiting(); });
// What the wait cost: from where base would have started to the wait's end. The wait itself began beside head.
const blocked = (input.timings ?? silentTimings).span("baseline-blocked");
const waited = await input.waited;
blocked(waited ? "ok" : "skipped");
if (headFailed) return;
if (!waited) return input.captureBase();
await input.head;
@@ -295,18 +291,12 @@ export type PublicCiOptions = {
/** Internal dependency injection for tests: replaces the wait for a baseline run that EXPLORE_BASELINE_RUN names. */
awaitBaseline?: BaselineWait;
progress?: Progress;
/** Where the run's timings are appended (`$RUNNER_TEMP/explore-diagnostics/timings.jsonl`); none are kept without it. */
timingsPath?: string;
progressPostMs?: number;
/** Stops the captures between steps (a cancelled job): a session is still stopped, and a hosted repack run cancelled. */
signal?: AbortSignal;
};
/**
* Waits for a baseline of the base commit still being captured: its downloaded export's directory, or undefined.
* `watch` hears what the baseline job is doing and records the wait.
*/
type BaselineWait = (signal: AbortSignal, watch?: Pick<BaselineWaitOptions, "onUpdate" | "timings">) => Promise<string | undefined>;
/** Waits for a baseline of the base commit still being captured: its downloaded export's directory, or undefined. */
type BaselineWait = (signal: AbortSignal) => Promise<string | undefined>;
/**
* The wait for a baseline still capturing the base commit: for the run `ci:find-baseline` named in
@@ -320,8 +310,8 @@ function pendingBaselineWait(options: Pick<PublicCiOptions, "awaitBaseline" | "c
const minutes = options.config.capture.baselineWaitMinutes ?? DEFAULT_BASELINE_WAIT_MINUTES;
if (!Number.isSafeInteger(run) || run <= 0 || minutes === 0) return undefined;
const target = options.target ?? options.platform ?? options.config.target?.id ?? "ios";
return (signal, watch) => awaitPendingBaseline({ run, sha: baseSha, target, timeoutMs: minutes * 60_000, directory: join(resolve(options.output), "baseline-download"),
environment, transport, signal, ...(options.progress ? { progress: options.progress } : {}), ...watch });
return signal => awaitPendingBaseline({ run, sha: baseSha, target, timeoutMs: minutes * 60_000, directory: join(resolve(options.output), "baseline-download"),
environment, transport, signal, ...(options.progress ? { progress: options.progress } : {}) });
}
function assertRunIdentity(environment: NodeJS.ProcessEnv): void {
@@ -369,7 +359,7 @@ export async function runCompareCi(options: Omit<PublicCiOptions, "pullRequestPa
const awaitBaseline = pendingBaselineWait(options, environment, options.transport ?? fetch, comparison.base.sha);
return runCiReview({ ...options, projects, output, state, presentation: comparison, ...(awaitBaseline ? { awaitBaseline } : {}),
environment, runId: environment.GITHUB_RUN_ID!, runAttempt: environment.GITHUB_RUN_ATTEMPT!,
assertCurrentHead, postComment: async () => {}, postProgress: async () => {} });
assertCurrentHead, postComment: async () => {} });
}
export async function runPublicCi(options: PublicCiOptions) {
@@ -380,17 +370,12 @@ export async function runPublicCi(options: PublicCiOptions) {
assertRunIdentity(environment);
const pr = projectPullRequestPresentation(JSON.parse(await readFile(options.pullRequestPath, "utf8")));
const { projects, output, state } = await prepareCiRun(options, environment, pr);
// One write at a time, each rendering the state when its turn comes: a progress post still in flight can never land
// after a later phase's post, or the failure's, and undo it.
let writing = Promise.resolve();
const upsert = () => (writing = writing.then(async () => {
const postComment = async () => {
await assertCurrentPr();
state.updatedAt = now(); const body = renderPublicComment(state); options.onComment?.(state, body);
try { await upsertStickyComment({ repository: pr.repository, issueNumber: pr.number, body, ...platformSectionMerge(state, options.target ?? options.platform), token: githubToken, fetchImpl: transport }); }
catch (error) { process.stderr.write(`Progress comment unavailable: ${serializeCiError(error).message}\n`); }
}));
const postComment = async () => { await assertCurrentPr(); await upsert(); };
// A status update between the phases' posts: it skips the PR check, whose failure would fail the review, and never throws.
const postProgress = async () => { if (!prVerificationFailed) await upsert().catch(() => undefined); };
};
let prVerificationFailed = false;
const assertCurrentPr = async () => {
try {
@@ -446,27 +431,7 @@ export async function runPublicCi(options: PublicCiOptions) {
const awaitBaseline = pendingBaselineWait(options, environment, transport, pr.base.sha);
return runCiReview({ ...options, projects, output, state, presentation: pr, ...(awaitBaseline ? { awaitBaseline } : {}),
environment, runId: environment.GITHUB_RUN_ID!, runAttempt: environment.GITHUB_RUN_ATTEMPT!,
assertCurrentHead, postComment, postProgress, canPublish: () => !prVerificationFailed });
}
/** The least time between two posts of the comment's waiting status, besides the posts that start and end the wait. */
const PROGRESS_POST_MS = 3 * 60_000;
/** Fetches the controllers in a span; a failure there ends the run before its phases, so it records the run's finish too. */
async function controllersTimed(timings: Timings, fetch: () => Promise<void>): Promise<void> {
try { await timings.measure("controllers", fetch); }
catch (error) {
timings.record({ type: "finish", outcome: "failed", code: toCiError(error).code });
throw error;
}
}
/** The run a timings file belongs to: the workflow, target, release, and run attempt, from the runner's variables. */
function runHeader(environment: NodeJS.ProcessEnv, config: ExploreConfig): RecordedEvent {
return { type: "run", release: EXPLORE_VERSION, ...(config.target ? { target: config.target.id } : {}),
...(environment.GITHUB_WORKFLOW ? { workflow: environment.GITHUB_WORKFLOW } : {}),
...(/^\d+$/.test(environment.GITHUB_RUN_ID ?? "") ? { run: environment.GITHUB_RUN_ID! } : {}),
...(/^\d+$/.test(environment.GITHUB_RUN_ATTEMPT ?? "") ? { attempt: environment.GITHUB_RUN_ATTEMPT! } : {}) };
assertCurrentHead, postComment, canPublish: () => !prVerificationFailed });
}
function planSummary(plan: SourceCapturePlan, baseline = false): string {
@@ -493,12 +458,6 @@ export async function runCiReview(options: {
measure?: Parameters<typeof assessPublicEvidence>[0]["measure"];
state: PublicCommentState; environment: NodeJS.ProcessEnv;
assertCurrentHead: () => Promise<void>; postComment: () => Promise<void>; canPublish?: () => boolean;
/** Posts the comment's state without verifying the PR first; best effort, for what changes between phases. */
postProgress?: () => Promise<void>;
/** The least time between two progress posts while base waits for a baseline (PROGRESS_POST_MS); tests shorten it. */
progressPostMs?: number;
/** Where the run's timings are appended; none are kept without it. */
timingsPath?: string;
now?: () => number; sleep?: (milliseconds: number) => void; runner?: CommandRunner; subscription?: boolean; useLocalEasSession?: boolean;
agentSessionFactory?: PrepareCiExplorationOptions["createSession"];
prepareCapture?: () => Promise<void>;
@@ -513,13 +472,10 @@ export async function runCiReview(options: {
}) {
const { projects, output, config, environment, state, assertCurrentHead, postComment } = options;
const progress = options.progress ?? silentProgress;
const timings = createTimings({ path: options.timingsPath, secrets: environmentSecrets(environment) });
timings.record(runHeader(environment, config));
const phases = phaseSequence(timings);
// The controllers are fetched before any EAS work, so a blocked download fails before a session is paid for. agent-device
// also compares the screenshots. An injected runner (tests) stands in for the controllers' calls, but not for that
// comparison: it still runs the real agent-device, which fetches itself on first use.
if (!options.runner) await controllersTimed(timings, () => prefetchControllers(config, environment, progress));
if (!options.runner) await prefetchControllers(config, environment, progress);
const pr = options.presentation;
const now = options.now ?? Date.now;
const secretValues = environmentSecrets(environment);
@@ -529,10 +485,7 @@ export async function runCiReview(options: {
let reportWritten = false;
// Stops a baseline wait still polling once the review no longer needs it: done, failed, or stopped.
const stopWaiting = new AbortController();
let progressPost: ReturnType<typeof setTimeout> | undefined;
let progressPostedAt = -Infinity;
try {
phases.enter("plan");
progress(`planning the review of ${pr.head.sha.slice(0, 8)} against base ${pr.base.sha.slice(0, 8)} (scope ${config.exploration.scope})`);
const plan = await buildVerifiedPlan({ baseProject: projects.base, headProject: projects.head,
baseSha: pr.base.sha, headSha: pr.head.sha, config, output });
@@ -547,7 +500,7 @@ export async function runCiReview(options: {
state.capture = { planned: { base: plan.baseCaptureSurfaceIds.length, head: plan.headCaptureSurfaceIds.length },
done: { base: 0, head: 0 }, baseFromCache: false };
await assertCurrentHead(); await postComment();
stage = "preflight"; phases.enter("preflight");
stage = "preflight";
const active = plan.headCaptureSurfaceIds.length + plan.baseCaptureSurfaceIds.length > 0;
if (active && !options.useLocalEasSession) requireSecret(environment, "EXPO_TOKEN");
const exploration = await prepareCiExploration(config, projects.head, environment, active,
@@ -564,22 +517,8 @@ export async function runCiReview(options: {
...(environment.EXPLORE_CAPTURE_CACHE ? { sourceDirectory: environment.EXPLORE_CAPTURE_CACHE } : {}), commit: pr.base.sha });
// With no finished baseline to reuse, one still being captured is waited for: from now, alongside head, and base
// waits for it only where it would start. Head is never delayed by it (brentvatne/euxy's review run 39348956443).
// While it waits, the comment says so and names the step the baseline job is in. It is posted when the wait starts
// and ends, and in between at most every `progressPostMs` with the latest step: every post rewrites the whole
// comment, which the other targets' jobs write too.
const waitingFor = (step?: string) => {
if (step === undefined) delete state.capture!.waiting;
else state.capture!.waiting = { on: "baseline", ...(step ? { step } : {}) };
clearTimeout(progressPost);
const post = () => { progressPostedAt = Date.now(); void options.postProgress?.(); };
const due = progressPostedAt + (options.progressPostMs ?? PROGRESS_POST_MS) - Date.now();
if (step === undefined || due <= 0) post();
else (progressPost = setTimeout(post, due)).unref();
};
const waitedBaseline = !baselineMayExist && plan.baseCaptureSurfaceIds.length > 0 && options.awaitBaseline
? options.awaitBaseline(options.signal ? AbortSignal.any([stopWaiting.signal, options.signal]) : stopWaiting.signal,
{ timings, onUpdate: update => waitingFor(update.step ?? "") }).catch(() => undefined)
.finally(() => { if (state.capture?.waiting) waitingFor(undefined); }) : undefined;
? options.awaitBaseline(options.signal ? AbortSignal.any([stopWaiting.signal, options.signal]) : stopWaiting.signal).catch(() => undefined) : undefined;
const share = targetSessionShare(config, options.targets, options.posedTargets);
// A share of one session captures the sides in turn.
const concurrent = captureSidesConcurrently({ plan, agent: !!exploration.agent, injectedRunner: !!options.runner, baselineMayExist }) && share >= 2;
@@ -615,7 +554,6 @@ export async function runCiReview(options: {
mapDirectory: join(output, `${side}-map`), outputDirectory: directory,
name: config.app.name ?? pr.repository, buildId: pr.origin === "local" ? `local-${pr.runId}-${side}` : pr.origin === "compare" ? `compare-${options.runId}-${side}` : `pr-${pr.number}-${side}`, buildVersion: pr[side].sha.slice(0, 8), gitCommit: pr[side].sha,
planPath: join(output, "execution-plan.json"), side, sessionStatePath: join(output, `${side}-session`), ...(options.buildShare ? { buildShare: options.buildShare } : {}),
...(options.timingsPath ? { timingsPath: options.timingsPath } : {}),
...repackShareOption(config, environment, options.repackPeers),
...(reuseDirectory ? { reuseDirectory } : {}), ...(options.signal ? { signal: options.signal } : {}) };
// A restored baseline already holds every appearance pass, so it never splits.
@@ -638,8 +576,7 @@ export async function runCiReview(options: {
await writeCaptureArtifactCache(directory, cacheRecipe);
};
const captureBase = (head: Promise<void>) => captureBaseAfterWait({ waited: waitedBaseline, head, stopWaiting: () => stopWaiting.abort(),
captureBase: cacheDirectory => captureSide("base", cacheDirectory), timings });
phases.enter("capture");
captureBase: cacheDirectory => captureSide("base", cacheDirectory) });
if (waitedBaseline) progress(`base waits for the baseline run of ${pr.base.sha.slice(0, 8)} still being captured; head captures meanwhile`);
if (concurrent) {
stage = "capture-head"; state.phase = "capturing"; state.capture.current = "head"; usagePhase = "capture-head";
@@ -661,7 +598,7 @@ export async function runCiReview(options: {
}
}
delete state.capture.current;
stage = "compare"; phases.enter("compare");
stage = "compare";
progress("comparing base and head captures");
const sides = { base: await evidenceSide(join(output, "base-export")), head: await evidenceSide(join(output, "head-export")) };
const system = systemRegions({ platform: config.app.platform, device: config.device.name, pose: config.device.pose });
@@ -718,7 +655,7 @@ export async function runCiReview(options: {
for (const diagnostic of failedComparisons) progress(renderComparisonDiagnosticAnnotation(diagnostic));
if (failedComparisons.length) progress(`${failedComparisons.length} comparison${failedComparisons.length === 1 ? "" : "s"} failed; the affected screens read as needing review`);
if (exploration.agent) {
stage = "notes"; phases.enter("notes");
stage = "notes";
usagePhase = "notes";
try {
const notes = await generateAgentChangeNotes({ review: result.review, assets: result.assets,
@@ -741,18 +678,12 @@ export async function runCiReview(options: {
await writeFile(join(output, "agent-notes-diagnostics.json"), JSON.stringify({ error: serializeCiError(failure) }));
}
}
phases.enter("report");
await preserveReport();
progress(pr.origin === "compare" || pr.origin === "local" ? "writing the report" : "writing the report and updating the pull request comment");
await assertCurrentHead(); await postComment();
phases.end();
timings.record({ type: "finish", outcome: "ok" });
return { ...result, evidence, inputPath };
} catch (error) {
state.phase = "failed"; const diagnostic = serializeCiError(error, { secrets: secretValues });
const cancelled = diagnostic.code === "CAPTURE_CANCELLED";
phases.end(cancelled ? "cancelled" : "failed", diagnostic.code);
timings.record({ type: "finish", outcome: cancelled ? "cancelled" : "failed", code: diagnostic.code });
state.failure = { step: stage, message: `${diagnostic.code}: ${diagnostic.message} ${diagnostic.nextAction}` };
try { await preserveReport?.(); } catch { /* Retain the original failure if its report cannot be written. */ }
// An exhausted verification already established that publication is unavailable; do not repeat its attempts.
@@ -762,7 +693,6 @@ export async function runCiReview(options: {
throw error;
} finally {
stopWaiting.abort();
clearTimeout(progressPost);
}
}
@@ -780,31 +710,10 @@ export async function runBaselineCi(options: { platform?: ExplorePlatform; proje
/** Agent mode with the local claude or codex login instead of the provider's API key. */
subscription?: boolean;
/** Stops the capture between steps (a cancelled job): its session is still stopped, and a hosted repack run cancelled. */
signal?: AbortSignal;
/** Where the run's timings are appended; none are kept without it. */
timingsPath?: string }) {
signal?: AbortSignal }) {
const environment = options.environment ?? process.env;
assertCheckout(options.project, options.sha);
const timings = createTimings({ path: options.timingsPath, labels: { side: "baseline" }, secrets: environmentSecrets(environment) });
timings.record(runHeader(environment, options.config));
if (!options.runner) await controllersTimed(timings, () => prefetchControllers(options.config, environment, options.progress ?? silentProgress));
const phases = phaseSequence(timings);
try {
phases.enter("plan");
const baseline = await captureBaseline(options, environment, phases);
phases.end();
timings.record({ type: "finish", outcome: "ok" });
return baseline;
} catch (error) {
const code = toCiError(error).code;
const outcome = code === "CAPTURE_CANCELLED" ? "cancelled" : "failed";
phases.end(outcome, code);
timings.record({ type: "finish", outcome, code });
throw error;
}
}
async function captureBaseline(options: Parameters<typeof runBaselineCi>[0], environment: NodeJS.ProcessEnv, phases: ReturnType<typeof phaseSequence>) {
if (!options.runner) await prefetchControllers(options.config, environment, options.progress ?? silentProgress);
const output = resolve(options.output);
const relativeOutput = relative(await realpath(options.project), output);
if (!relativeOutput.startsWith("..") || isAbsolute(relativeOutput)) throw new Error("Baseline output must be outside the source checkout");
@@ -814,7 +723,6 @@ async function captureBaseline(options: Parameters<typeof runBaselineCi>[0], env
baseSha: options.sha, headSha: options.sha, config: options.config, output, scope: "all" });
progress(planSummary(plan, true));
const active = plan.headCaptureSurfaceIds.length > 0;
phases.enter("preflight");
if (active && !options.useLocalEasSession) requireSecret(environment, "EXPO_TOKEN");
let usagePhase: AgentUsagePhase = "preflight";
const exploration = await prepareCiExploration(options.config, options.project, environment, active,
@@ -828,7 +736,6 @@ async function captureBaseline(options: Parameters<typeof runBaselineCi>[0], env
mapDirectory: join(output, "baseline-map"), outputDirectory: directory, name: options.config.app.name ?? options.config.app.bundleId,
buildId: `baseline-${options.sha.slice(0, 12)}`, buildVersion: options.sha.slice(0, 8), gitCommit: options.sha,
side: "head", planPath: join(output, "execution-plan.json"), sessionStatePath: join(output, "baseline-session"),
...(options.timingsPath ? { timingsPath: options.timingsPath, timingsSide: "baseline" } : {}),
...repackShareOption(options.config, environment, options.repackPeers), ...(options.signal ? { signal: options.signal } : {}) };
const share = targetSessionShare(options.config, options.targets, options.posedTargets);
// Passes on worker threads cannot take an injected runner or an agent session.
@@ -836,9 +743,7 @@ async function captureBaseline(options: Parameters<typeof runBaselineCi>[0], env
? await sideAppearancePasses(options.config, environment, { share, sides: 1, routes: plan.headCaptureSurfaceIds.length, project: options.project }) : undefined;
progress(`sessions: ${share} of ${options.config.capture.maxSessions ?? DEFAULT_MAX_SESSIONS} for this target; `
+ (passes ? `capturing ${passes.map(pass => pass.join("+")).join(" and ")} in separate sessions` : "one session"));
phases.enter("capture");
const result = await captureSideInSessions(baselineOptions, passes, progress, options.signal, passes !== undefined);
phases.enter("report");
const cacheRecipe = await recipe(options.config, plan, "head", environment, exploration.instructionsSha256);
if (options.subscription) cacheRecipe.toolsCommit += ":local-subscription";
const bundle = await readCaptureBundle(directory); bundle.profile = cacheRecipe.profile;
+5 -15
View File
@@ -21,7 +21,6 @@ import { help } from "./help.js";
import { CiError } from "../shared/ci-errors.js";
import { cleanupAfterCapture, findOptionalBaseline, resolveCompareRefs, resolvePullRequest, writeCaptureOutputs, writeStepOutputs } from "../ci/workflow-steps.js";
import { stderrProgress } from "../shared/progress.js";
import { appendTimingsSummary, timingsPathFor } from "../shared/timings.js";
import { maxParallelTargets } from "../ci/session-plan.js";
export async function doctor(): Promise<void> {
@@ -138,8 +137,6 @@ export async function ciCompareRefs(): Promise<void> {
/** `ci:after-capture --output DIR --checkout DIR...`: stop recorded sessions and check the checkouts are untouched; fails after reporting every problem. */
export async function ciAfterCapture(): Promise<void> {
// The timings table of a capture stopped before it could write one; a summary that cannot be written changes nothing here.
await appendTimingsSummary().catch(() => false);
const result = await cleanupAfterCapture({ output: required("output"), checkouts: flags("checkout") });
for (const failure of result.failures) console.error(`::error title=${failure.code}::${failure.message} ${failure.nextAction}`);
output({ ok: result.failures.length === 0, ...result });
@@ -264,13 +261,9 @@ export async function captureReview(): Promise<void> {
const common = { ...(named ? { target: config.target!.id } : {}), ...(selection.platform ? { platform: selection.platform } : {}),
platforms: listPlatforms(rawConfig), targets: configTargets(rawConfig), posedTargets: posedTargets(rawConfig), repackPeers: hostedRepackPeers(rawConfig, config, overrides),
baseProject: required("base-project"), headProject,
output: required("output"), config, configPath, progress: stderrProgress(), signal: ciInterrupt(),
...(timingsPathFor(process.env) ? { timingsPath: timingsPathFor(process.env)! } : {}) };
let result;
try {
result = has("compare") ? await runCompareCi({ ...common, comparePath: required("compare") })
: await runPublicCi({ ...common, pullRequestPath: required("pull-request") });
} finally { await appendTimingsSummary().catch(() => false); }
output: required("output"), config, configPath, progress: stderrProgress(), signal: ciInterrupt() };
const result = has("compare") ? await runCompareCi({ ...common, comparePath: required("compare") })
: await runPublicCi({ ...common, pullRequestPath: required("pull-request") });
// The deploy job runs only when the reviewed config asks for a hosted report.
await writeCaptureOutputs(result.inputPath);
output({ ok: true, inputPath: result.inputPath });
@@ -281,11 +274,8 @@ export async function captureBaseline(): Promise<void> {
const rawConfig = await readExploreConfig(project, flag("config") ?? DEFAULT_EXPLORE_CONFIG_PATH);
const overrides = { controller: flag("controller"), simulator: flag("simulator"), repack: flag("repack") };
const config = withRunOverrides(resolveTargetConfig(rawConfig, targetSelection()), overrides);
const timingsPath = timingsPathFor(process.env);
try {
output({ ok: true, ...await runBaselineCi({ platform: config.app.platform, project, sha: required("sha"), output: required("output"), config, targets: configTargets(rawConfig), posedTargets: posedTargets(rawConfig),
repackPeers: hostedRepackPeers(rawConfig, config, overrides), progress: stderrProgress(), signal: ciInterrupt(), ...(timingsPath ? { timingsPath } : {}) }) });
} finally { await appendTimingsSummary().catch(() => false); }
output({ ok: true, ...await runBaselineCi({ platform: config.app.platform, project, sha: required("sha"), output: required("output"), config, targets: configTargets(rawConfig), posedTargets: posedTargets(rawConfig),
repackPeers: hostedRepackPeers(rawConfig, config, overrides), progress: stderrProgress(), signal: ciInterrupt() }) });
}
/** `capture` (or `capture:review`) `[--base REF] [--head REF | --committed]`: a local review, opened in the Viewer or hosted with --upload. */
+1 -7
View File
@@ -48,8 +48,6 @@ export type PublicCommentState = {
baseFromCache: boolean;
/** Which side is being captured right now, while `capturing`. */
current?: "base" | "head";
/** Base waits for the default branch's baseline of its commit, still being captured; `step` is the baseline job's current step. */
waiting?: { on: "baseline"; step?: string };
};
review?: PublicReview;
evidence?: PublicEvidenceSummary;
@@ -292,8 +290,7 @@ export function platformRecordOf(state: PublicCommentState, target?: CommentTarg
record.app = { ...(state.build.appName ? { name: state.build.appName } : {}), ...(state.build.appVersion ? { version: state.build.appVersion } : {}),
...(state.build.appBuildNumber ? { build: state.build.appBuildNumber } : {}) };
}
if (state.capture) record.capture = { planned: { ...state.capture.planned }, done: { ...state.capture.done }, baseFromCache: state.capture.baseFromCache, ...(state.capture.current ? { current: state.capture.current } : {}),
...(state.capture.waiting ? { waiting: { ...state.capture.waiting } } : {}) };
if (state.capture) record.capture = { planned: { ...state.capture.planned }, done: { ...state.capture.done }, baseFromCache: state.capture.baseFromCache, ...(state.capture.current ? { current: state.capture.current } : {}) };
const health = captureHealth(state);
if (health && (state.phase === "ready" || state.phase === "failed")) record.health = { base: { ...health.base }, head: { ...health.head } };
if (state.phase === "ready") {
@@ -518,9 +515,6 @@ function statusLine(record: PlatformRecord): string | undefined {
case "capturing": {
const capture = record.capture;
if (!capture) return `${label} · capturing · ${run}`;
// Head goes on while base waits for the baseline; once head is done, the wait is all there is to say.
if (capture.waiting) return `${label} · head ${capture.done.head}/${capture.planned.head} · base waits for the default branch's baseline`
+ `${capture.waiting.step ? ` (in “${inlineText(capture.waiting.step, 80)}”)` : ""} · ${run}`;
const side = capture.current ?? (capture.done.head > 0 || capture.baseFromCache ? "head" : "base");
return `${label} · capturing ${side} ${capture.done[side]}/${capture.planned[side]}${capture.baseFromCache && side === "head" ? " · base reused" : ""} · ${run}`;
}
+2 -5
View File
@@ -96,8 +96,7 @@ export type PlatformRecord = {
device?: string;
app?: { name?: string; version?: string; build?: string };
links: { run: string; report?: string; download?: string; artifacts: string; config: string; expiresAt?: number | null; deploying?: true };
capture?: { planned: { base: number; head: number }; done: { base: number; head: number }; baseFromCache: boolean; current?: "base" | "head";
waiting?: { on: "baseline"; step?: string } };
capture?: { planned: { base: number; head: number }; done: { base: number; head: number }; baseFromCache: boolean; current?: "base" | "head" };
health?: { base: SideHealth; head: SideHealth };
validation?: {
visual?: { compared: number; threshold: number; eligible?: number; skipped?: number; failed: number };
@@ -253,9 +252,7 @@ export function parsePlatformRecord(value: unknown): PlatformRecord | undefined
}
if (isRecord(value.capture) && pair(value.capture.planned) && pair(value.capture.done) && typeof value.capture.baseFromCache === "boolean") {
record.capture = { planned: { base: value.capture.planned.base, head: value.capture.planned.head }, done: { base: value.capture.done.base, head: value.capture.done.head },
baseFromCache: value.capture.baseFromCache, ...(isSide(value.capture.current) ? { current: value.capture.current } : {}),
...(isRecord(value.capture.waiting) && value.capture.waiting.on === "baseline"
? { waiting: { on: "baseline" as const, ...(isString(value.capture.waiting.step, 80) ? { step: value.capture.waiting.step } : {}) } } : {}) };
baseFromCache: value.capture.baseFromCache, ...(isSide(value.capture.current) ? { current: value.capture.current } : {}) };
}
if (isRecord(value.health) && health(value.health.base) && health(value.health.head)) {
const pick = (side: SideHealth): SideHealth => ({ planned: side.planned, captured: side.captured, verified: side.verified, unverified: side.unverified, unavailable: side.unavailable });
+4 -7
View File
@@ -60,8 +60,7 @@ export function environmentSecrets(environment: NodeJS.ProcessEnv): string[] {
return Object.entries(environment).filter(([key]) => /(?:TOKEN|SECRET|PASSWORD|API_KEY)/i.test(key)).flatMap(([, value]) => value ? [value] : []);
}
/** Redacts secret values, bearer and provider tokens, credentials in URLs, and signed-URL parameters from any text Explore writes. */
export function redactSecrets(value: string, secrets: readonly string[]): string {
function redact(value: string, secrets: readonly string[]): string {
let result = value;
// Controller failures may embed JSON or URLs inside their message rather than
// returning the original input as a separate structured field.
@@ -78,14 +77,12 @@ export function redactSecrets(value: string, secrets: readonly string[]): string
return result
.replace(/\bBearer\s+[^\s,;]+/gi, "Bearer [REDACTED]")
.replace(/\b(?:gh[pousr]_[A-Za-z0-9_]+|github_pat_[A-Za-z0-9_]+|sk-(?:ant-)?[A-Za-z0-9_-]{12,})\b/g, "[REDACTED]")
// In a query or a fragment: a simulator session's public preview link carries its token in the fragment, and an
// object store's signed link its credential and signature among the query's X-Amz- or X-Goog- parameters.
.replace(/([?&#](?:access_token|token|api_key|key|signature|sig|se|sv|x-(?:amz|goog)-(?:signature|credential|security-token))=)[^&#\s]*/gi, "$1[REDACTED]")
.replace(/([?&](?:access_token|token|api_key|key|signature|sig)=)[^&#\s]*/gi, "$1[REDACTED]")
.replace(/(https?:\/\/)[^\s/@]+:[^\s/@]+@/gi, "$1[REDACTED]@");
}
function clean(value: unknown, secrets: readonly string[], seen = new Set<object>()): unknown {
if (typeof value === "string") return redactSecrets(value, secrets);
if (typeof value === "string") return redact(value, secrets);
if (value === null || typeof value !== "object") return value;
if (seen.has(value)) return "[Circular]";
seen.add(value);
@@ -186,7 +183,7 @@ export async function reportCiError(error: unknown, options: {
for (const [index, result] of results.entries()) {
if (result.status === "rejected") {
const code = (result.reason as NodeJS.ErrnoException | undefined)?.code;
const reason = typeof code === "string" ? ` (${redactSecrets(code, secrets)})` : "";
const reason = typeof code === "string" ? ` (${redact(code, secrets)})` : "";
write(`::warning title=Explore diagnostics::${annotationData(`Could not write the ${outputs[index]!.label}${reason}. Check runner output permissions. The original failure above still applies.`)}`);
}
}
-308
View File
@@ -1,308 +0,0 @@
import { randomUUID } from "node:crypto";
import { appendFileSync, mkdirSync } from "node:fs";
import { appendFile, readFile, writeFile } from "node:fs/promises";
import { dirname, resolve } from "node:path";
import { redactSecrets, type CiError } from "./ci-errors.js";
import type { Progress } from "./progress.js";
/**
* Where a capture job's time goes, appended as JSON lines to `explore-diagnostics/timings.jsonl` as the job runs, so a
* job killed partway still leaves what it did up to then, and rendered as a table in the job summary at the end.
*
* What is written is closed by construction: a phase from this list, ids, counts, durations and outcome codes. Strings
* pass through `safeText`, which redacts secrets and drops anything shaped like a link; links are built only by
* `githubRunLink` and `easPageLink`. The diagnostics artifact is uploaded from public repositories.
*/
export const TIMING_PHASES = [
"controllers", "plan", "preflight", "appearance-config", "baseline-wait", "baseline-blocked", "baseline-restore",
"configuration", "fingerprint", "build-lookup", "native-build", "repack", "repack-share-wait", "build-download",
"session-start", "session-verify", "install", "launch", "route", "pass", "export", "session-stop",
"capture", "compare", "notes", "report",
] as const;
export type TimingPhase = typeof TIMING_PHASES[number];
export type TimingOutcome = "ok" | "failed" | "cancelled" | "skipped";
export type TimingAttributes = Readonly<Record<string, string | number | boolean | undefined>>;
/** Which capture an event belongs to: a side of a review (or the baseline), and the appearance pass of a split side. */
export type TimingLabels = { side?: string | undefined; pass?: string | undefined };
/** What a recorder writes besides spans: the run it belongs to, how it finished, and a step of the baseline job it waited for. */
export type RecordedEvent =
| { type: "run"; workflow?: string; target?: string; release?: string; run?: string; attempt?: string }
| { type: "baseline-step"; name: string; ms: number; conclusion: string }
| { type: "finish"; outcome: TimingOutcome; code?: string };
export type TimingEvent = (
| RecordedEvent
| { type: "start"; id: string; phase: TimingPhase; attributes?: TimingAttributes }
| { type: "end"; id: string; phase: TimingPhase; ms: number; outcome: TimingOutcome; attributes?: TimingAttributes }
) & { at: number; side?: string; pass?: string };
export type SpanEnd = (outcome?: TimingOutcome, attributes?: TimingAttributes) => void;
export type Timings = {
/** Opens a span; the function it returns closes it, once. */
span(phase: TimingPhase, attributes?: TimingAttributes): SpanEnd;
/** Runs `run` in a span that ends `ok` when it returns (or its promise resolves) and `failed` or `cancelled` when it throws. */
measure<T>(phase: TimingPhase, run: () => T, attributes?: TimingAttributes): T;
/** A run header, a finish line or a step of the baseline job. */
record(event: RecordedEvent): void;
/** The same file, with these labels on every event. */
labelled(labels: TimingLabels): Timings;
};
/**
* Says that the calling thread is about to block in a synchronous subprocess for up to `boundMs`, and returns the
* function that says it is done. A capture on a worker thread passes one that tells the parent, whose thread is free
* to print a line while the worker is blocked (runCiMapOnWorker); on the main thread nothing can run meanwhile.
*/
export type BlockingNotice = (phase: TimingPhase, boundMs: number) => () => void;
export const silentTimings: Timings = {
span: () => () => {},
measure: (_phase, run) => run(),
record: () => {},
labelled: () => silentTimings,
};
const SAFE_TEXT_LENGTH = 80;
/** Text from outside Explore (a workflow step's name), made safe to publish: redacted, without links, on one short line. */
export function safeText(value: string, secrets: readonly string[] = []): string {
const text = redactSecrets(value, secrets).replace(/\b[a-z][a-z0-9+.-]*:\/\/\S+/gi, "[link]").replace(/\s+/g, " ").trim();
return text.length > SAFE_TEXT_LENGTH ? `${text.slice(0, SAFE_TEXT_LENGTH - 1)}…` : text;
}
function safeAttributes(attributes: TimingAttributes | undefined, secrets: readonly string[]): TimingAttributes | undefined {
if (!attributes) return undefined;
const entries = Object.entries(attributes).filter(([, value]) => value !== undefined)
.map(([key, value]) => [key, typeof value === "string" ? safeText(value, secrets) : value] as const);
return entries.length ? Object.fromEntries(entries) : undefined;
}
/** A failure's closed code, never its message: a CiError's code (read by shape, as one rebuilt from a worker is), or none. */
function failure(error: unknown): { outcome: TimingOutcome; code?: string } {
const code = error instanceof Error && typeof (error as Partial<CiError>).code === "string" && /^[A-Z][A-Z0-9_]{0,63}$/.test((error as CiError).code)
? (error as CiError).code : undefined;
if (code === "CAPTURE_CANCELLED" || error instanceof Error && error.name === "AbortError") return { outcome: "cancelled", ...(code ? { code } : {}) };
return { outcome: "failed", ...(code ? { code } : {}) };
}
/**
* A recorder appending to `path`, or one that records nothing without a path. Each event is one synchronous append,
* small enough that two threads appending to the same file never interleave within a line. A failed write is
* dropped: timing a capture must never fail it.
*/
export function createTimings(options: { path?: string | undefined; labels?: TimingLabels; secrets?: readonly string[]; now?: () => number }): Timings {
if (!options.path) return silentTimings;
const path = options.path;
const now = options.now ?? Date.now;
const secrets = options.secrets ?? [];
const prefix = randomUUID().slice(0, 8);
let next = 0;
let ready = false;
const write = (event: TimingEvent) => {
try {
if (!ready) { mkdirSync(dirname(path), { recursive: true }); ready = true; }
appendFileSync(path, `${JSON.stringify(event)}\n`);
} catch { /* Best effort. */ }
};
const build = (labels: TimingLabels): Timings => {
const tagged = { ...(labels.side ? { side: labels.side } : {}), ...(labels.pass ? { pass: labels.pass } : {}) };
const span = (phase: TimingPhase, attributes?: TimingAttributes): SpanEnd => {
const id = `${prefix}-${next++}`;
const started = now();
const opened = safeAttributes(attributes, secrets);
write({ type: "start", id, phase, at: started, ...tagged, ...(opened ? { attributes: opened } : {}) });
let ended = false;
return (outcome = "ok", more) => {
if (ended) return;
ended = true;
// The end repeats what the span opened with, so each line reads on its own.
const closed = safeAttributes(more ? { ...attributes, ...more } : attributes, secrets);
write({ type: "end", id, phase, at: now(), ms: Math.max(0, now() - started), outcome, ...tagged, ...(closed ? { attributes: closed } : {}) });
};
};
return {
span,
measure: (phase, run, attributes) => {
const end = span(phase, attributes);
const fail = (error: unknown) => {
const { outcome, code } = failure(error);
end(outcome, code ? { code } : undefined);
};
let result;
try { result = run(); } catch (error) { fail(error); throw error; }
if (result instanceof Promise) return result.then(value => { end(); return value; }, (error: unknown) => { fail(error); throw error; }) as typeof result;
end();
return result;
},
record: event => {
const cleaned = Object.fromEntries(Object.entries(event).map(([key, value]) => [key, typeof value === "string" && key !== "type" ? safeText(value, secrets) : value]));
write({ ...cleaned as RecordedEvent, at: now(), ...tagged });
},
labelled: more => build({ ...labels, ...Object.fromEntries(Object.entries(more).filter(([, value]) => value !== undefined)) }),
};
};
return build(options.labels ?? {});
}
/**
* Consecutive phases of one flow (plan, preflight, capture, compare, report): entering a phase ends the one before it
* as `ok`; `end` closes the current one with how the flow ended.
*/
export function phaseSequence(timings: Timings): { enter(phase: TimingPhase): void; end(outcome?: TimingOutcome, code?: string): void } {
let current: SpanEnd | undefined;
return {
enter: phase => { current?.(); current = timings.span(phase); },
end: (outcome = "ok", code) => { current?.(outcome, code ? { code } : undefined); current = undefined; },
};
}
/** Runs a synchronous call that can block for minutes in a span, telling `notice` (when there is one) while it runs. */
export function blockingCall<T>(timings: Timings, notice: BlockingNotice | undefined, phase: TimingPhase, boundMs: number, run: () => T): T {
const done = notice?.(phase, boundMs);
try { return timings.measure(phase, run, { boundMs }); }
finally { done?.(); }
}
/** Prints the first line at once, then at most one every `intervalMs`: a wait's heartbeat, driven by its own poll loop. */
export function throttledProgress(progress: Progress, options: { now?: () => number; intervalMs?: number } = {}): Progress {
const now = options.now ?? Date.now;
const interval = options.intervalMs ?? 60_000;
let last: number | undefined;
return message => {
const at = now();
if (last !== undefined && at - last < interval) return;
last = at;
progress(message);
};
}
/** The Actions run's page, from the server and repository the runner names and a numeric run id. */
export function githubRunLink(environment: NodeJS.ProcessEnv, run: number | string): string | undefined {
const server = environment.GITHUB_SERVER_URL ?? "https://github.com";
const repository = environment.GITHUB_REPOSITORY ?? "";
if (!/^\d{1,20}$/.test(String(run)) || !/^[\w.-]+\/[\w.-]+$/.test(repository) || !/^https:\/\/[\w.-]+(?::\d+)?$/.test(server)) return undefined;
return `${server}/${repository}/actions/runs/${run}`;
}
const EAS_PAGE = /^\/accounts\/([\w.-]{1,100})\/projects\/([\w.-]{1,100})\/(workflows|builds)\/([A-Za-z0-9-]{1,128})\/?$/;
/**
* An expo.dev workflow-run or build page, rebuilt from the parts of `value` that name it, or nothing. eas-cli prints
* these links; this keeps a query or a fragment it might carry from ever being written out.
*/
export function easPageLink(value: string | undefined, kind: "workflows" | "builds"): string | undefined {
// A link at the end of a sentence ("See logs: https://…/workflows/01AB.") brings its punctuation along.
const trimmed = value?.replace(/[.,;:!?)\]'"]+$/, "");
if (!trimmed || !URL.canParse(trimmed)) return undefined;
const url = new URL(trimmed);
const match = EAS_PAGE.exec(url.pathname);
if (url.protocol !== "https:" || url.hostname !== "expo.dev" || url.port || url.username || url.password || !match || match[3] !== kind) return undefined;
return `https://expo.dev/accounts/${match[1]}/projects/${match[2]}/${kind}/${match[4]}`;
}
/** "850 ms", "42 s", "2 min 14 s". */
export function formatDuration(ms: number): string {
if (ms < 1000) return `${Math.round(ms)} ms`;
const seconds = Math.round(ms / 1000);
if (seconds < 60) return `${seconds} s`;
const minutes = Math.floor(seconds / 60);
return seconds % 60 ? `${minutes} min ${seconds % 60} s` : `${minutes} min`;
}
function readEvents(jsonl: string): TimingEvent[] {
return jsonl.split("\n").flatMap(line => {
if (!line.trim()) return [];
try {
const value = JSON.parse(line) as TimingEvent;
return value && typeof value === "object" && typeof value.type === "string" && typeof value.at === "number" ? [value] : [];
} catch { return []; }
});
}
const markdownCell = (value: string) => value.replace(/[|\\`*_[\]<>]/g, character => `\\${character}`);
const percentile = (sorted: readonly number[], p: number) => sorted[Math.min(sorted.length - 1, Math.max(0, Math.ceil(p * sorted.length) - 1))]!;
/** Rows each section of the summary keeps, so a long run cannot crowd out another section. */
const SUMMARY_ROWS = { phases: 24, slowest: 3, steps: 12, unfinished: 8 };
/**
* The job summary's table: what each phase took per side and pass (spans overlap, so their sum exceeds the job's
* wall time), the routes, what the baseline job spent its time on, and spans that never ended.
*/
export function renderTimingsSummary(jsonl: string): string {
const events = readEvents(jsonl);
if (!events.length) return "";
const header = events.find(event => event.type === "run") as Extract<TimingEvent, { type: "run" }> | undefined;
const finish = [...events].reverse().find(event => event.type === "finish") as Extract<TimingEvent, { type: "finish" }> | undefined;
const ends = events.filter((event): event is Extract<TimingEvent, { type: "end" }> => event.type === "end");
const ended = new Set(ends.map(event => event.id));
const unfinished = events.filter((event): event is Extract<TimingEvent, { type: "start" }> => event.type === "start" && !ended.has(event.id));
const first = Math.min(...events.map(event => event.at));
const last = Math.max(...events.map(event => event.at));
const label = (event: { side?: string; pass?: string }) => [event.side, event.pass].filter(Boolean).join(" · ") || "—";
const lines = [`### Explore capture timings${header?.target ? ` · ${markdownCell(header.target)}` : ""}`, ""];
lines.push(`${formatDuration(last - first)} from the first event to the last${finish ? `; ${finish.outcome}${finish.code ? ` (${markdownCell(finish.code)})` : ""}` : "; no finish recorded"}. Phases overlap, so they add up to more.`, "");
const groups = new Map<string, { phase: TimingPhase; who: string; count: number; total: number; longest: number; failed: number }>();
for (const event of ends) {
if (event.phase === "route") continue;
const key = `${event.phase}\0${label(event)}`;
const group = groups.get(key) ?? { phase: event.phase, who: label(event), count: 0, total: 0, longest: 0, failed: 0 };
group.count += 1; group.total += event.ms; group.longest = Math.max(group.longest, event.ms);
if (event.outcome !== "ok") group.failed += 1;
groups.set(key, group);
}
const rows = [...groups.values()].sort((a, b) => b.total - a.total);
if (rows.length) {
lines.push("| Phase | Side | Count | Total | Longest | Not ok |", "| --- | --- | --: | --: | --: | --: |");
for (const row of rows.slice(0, SUMMARY_ROWS.phases)) {
lines.push(`| ${row.phase} | ${markdownCell(row.who)} | ${row.count} | ${formatDuration(row.total)} | ${formatDuration(row.longest)} | ${row.failed || ""} |`);
}
if (rows.length > SUMMARY_ROWS.phases) lines.push(`| … ${rows.length - SUMMARY_ROWS.phases} more in timings.jsonl | | | | | |`);
lines.push("");
}
const routes = ends.filter(event => event.phase === "route");
if (routes.length) {
const sorted = routes.map(event => event.ms).sort((a, b) => a - b);
const slowest = [...routes].sort((a, b) => b.ms - a.ms).slice(0, SUMMARY_ROWS.slowest)
.map(event => `${markdownCell(String(event.attributes?.route ?? "?"))} ${formatDuration(event.ms)}`);
lines.push(`**Routes:** ${routes.length}, median ${formatDuration(percentile(sorted, 0.5))}, p90 ${formatDuration(percentile(sorted, 0.9))}; slowest ${slowest.join(", ")}.`, "");
}
const steps = events.filter((event): event is Extract<TimingEvent, { type: "baseline-step" }> => event.type === "baseline-step");
if (steps.length) {
lines.push("**The baseline job's steps while this review waited for it:**", "");
for (const step of steps.slice(0, SUMMARY_ROWS.steps)) lines.push(`- ${markdownCell(step.name)}: ${formatDuration(step.ms)} (${markdownCell(step.conclusion)})`);
lines.push("");
}
if (unfinished.length) {
lines.push(`**Never finished** (the job ended first): ${unfinished.slice(0, SUMMARY_ROWS.unfinished)
.map(event => `${event.phase}${event.side ? ` (${markdownCell(label(event))})` : ""}, ${formatDuration(last - event.at)}+`).join("; ")}.`, "");
}
return `${lines.join("\n")}\n`;
}
/** Where a CI job's timings go: the diagnostics folder every capture job uploads `if: always()`. None outside Actions. */
export function timingsPathFor(environment: NodeJS.ProcessEnv): string | undefined {
return environment.GITHUB_ACTIONS === "true" && environment.RUNNER_TEMP ? resolve(environment.RUNNER_TEMP, "explore-diagnostics", "timings.jsonl") : undefined;
}
/**
* Appends the job's timings table to its summary, once per job: the capture command does when it ends, and
* `ci:after-capture` does for a capture that was stopped before it could (a second signal ends it at once).
*/
export async function appendTimingsSummary(environment: NodeJS.ProcessEnv = process.env): Promise<boolean> {
const path = timingsPathFor(environment);
if (!path || !environment.GITHUB_STEP_SUMMARY) return false;
const mark = `${path}.summarized`;
if (await readFile(mark).then(() => true, () => false)) return false;
const summary = renderTimingsSummary(await readFile(path, "utf8").catch(() => ""));
if (!summary) return false;
await appendFile(environment.GITHUB_STEP_SUMMARY, `${summary}\n`);
await writeFile(mark, "");
return true;
}
+3 -5
View File
@@ -87,16 +87,14 @@ jobs:
shell: bash
# Launch recordings (capture.launch) are decoded with ffmpeg; GitHub's Ubuntu runners do not ship it. A package
# mirror can stall without failing, so each apt-get call has network timeouts and a time limit, and a stalled
# attempt is tried once more: the step fails in minutes rather than holding the job to its timeout. timeout runs
# under sudo so its signal reaches apt-get itself, and -k kills an apt-get that does not exit on it: without -k,
# timeout waits for the command however long it takes (brentvatne/euxy review run 40042718931 waited 7 minutes).
# attempt is tried once more: the step fails in minutes rather than holding the job to its timeout.
timeout-minutes: 10
run: |
set -euo pipefail
if ! command -v ffmpeg > /dev/null; then
apt=(apt-get -qq -o Acquire::Retries=3 -o Acquire::http::Timeout=30 -o Acquire::https::Timeout=30 -o DPkg::Lock::Timeout=120)
apt=(sudo apt-get -qq -o Acquire::Retries=3 -o Acquire::http::Timeout=30 -o Acquire::https::Timeout=30 -o DPkg::Lock::Timeout=120)
for attempt in 1 2; do
if sudo timeout -k 10 120 "${apt[@]}" update && sudo timeout -k 10 120 "${apt[@]}" install -y --no-install-recommends ffmpeg > /dev/null; then break; fi
if timeout 120 "${apt[@]}" update && timeout 120 "${apt[@]}" install -y --no-install-recommends ffmpeg > /dev/null; then break; fi
if [ "$attempt" = 2 ]; then echo '::error title=LAUNCH_DECODER_INSTALL_FAILED::apt-get could not install ffmpeg; rerun the job.'; exit 1; fi
echo "::warning title=LAUNCH_DECODER_INSTALL_RETRY::apt-get did not install ffmpeg on attempt $attempt; trying again."
done
+3 -5
View File
@@ -124,16 +124,14 @@ jobs:
shell: bash
# Launch recordings (capture.launch) are decoded with ffmpeg; GitHub's Ubuntu runners do not ship it. A package
# mirror can stall without failing, so each apt-get call has network timeouts and a time limit, and a stalled
# attempt is tried once more: the step fails in minutes rather than holding the job to its timeout. timeout runs
# under sudo so its signal reaches apt-get itself, and -k kills an apt-get that does not exit on it: without -k,
# timeout waits for the command however long it takes (brentvatne/euxy review run 40042718931 waited 7 minutes).
# attempt is tried once more: the step fails in minutes rather than holding the job to its timeout.
timeout-minutes: 10
run: |
set -euo pipefail
if ! command -v ffmpeg > /dev/null; then
apt=(apt-get -qq -o Acquire::Retries=3 -o Acquire::http::Timeout=30 -o Acquire::https::Timeout=30 -o DPkg::Lock::Timeout=120)
apt=(sudo apt-get -qq -o Acquire::Retries=3 -o Acquire::http::Timeout=30 -o Acquire::https::Timeout=30 -o DPkg::Lock::Timeout=120)
for attempt in 1 2; do
if sudo timeout -k 10 120 "${apt[@]}" update && sudo timeout -k 10 120 "${apt[@]}" install -y --no-install-recommends ffmpeg > /dev/null; then break; fi
if timeout 120 "${apt[@]}" update && timeout 120 "${apt[@]}" install -y --no-install-recommends ffmpeg > /dev/null; then break; fi
if [ "$attempt" = 2 ]; then echo '::error title=LAUNCH_DECODER_INSTALL_FAILED::apt-get could not install ffmpeg; rerun the job.'; exit 1; fi
echo "::warning title=LAUNCH_DECODER_INSTALL_RETRY::apt-get did not install ffmpeg on attempt $attempt; trying again."
done
+3 -5
View File
@@ -113,16 +113,14 @@ jobs:
shell: bash
# Launch recordings (capture.launch) are decoded with ffmpeg; GitHub's Ubuntu runners do not ship it. A package
# mirror can stall without failing, so each apt-get call has network timeouts and a time limit, and a stalled
# attempt is tried once more: the step fails in minutes rather than holding the job to its timeout. timeout runs
# under sudo so its signal reaches apt-get itself, and -k kills an apt-get that does not exit on it: without -k,
# timeout waits for the command however long it takes (brentvatne/euxy review run 40042718931 waited 7 minutes).
# attempt is tried once more: the step fails in minutes rather than holding the job to its timeout.
timeout-minutes: 10
run: |
set -euo pipefail
if ! command -v ffmpeg > /dev/null; then
apt=(apt-get -qq -o Acquire::Retries=3 -o Acquire::http::Timeout=30 -o Acquire::https::Timeout=30 -o DPkg::Lock::Timeout=120)
apt=(sudo apt-get -qq -o Acquire::Retries=3 -o Acquire::http::Timeout=30 -o Acquire::https::Timeout=30 -o DPkg::Lock::Timeout=120)
for attempt in 1 2; do
if sudo timeout -k 10 120 "${apt[@]}" update && sudo timeout -k 10 120 "${apt[@]}" install -y --no-install-recommends ffmpeg > /dev/null; then break; fi
if timeout 120 "${apt[@]}" update && timeout 120 "${apt[@]}" install -y --no-install-recommends ffmpeg > /dev/null; then break; fi
if [ "$attempt" = 2 ]; then echo '::error title=LAUNCH_DECODER_INSTALL_FAILED::apt-get could not install ffmpeg; rerun the job.'; exit 1; fi
echo "::warning title=LAUNCH_DECODER_INSTALL_RETRY::apt-get did not install ffmpeg on attempt $attempt; trying again."
done
-83
View File
@@ -83,89 +83,6 @@ test('head capture starts while the review waits for the baseline, and the waite
assert.equal(waitSignal.aborted, true, 'the wait is told to stop once the review is done');
});
test('while base waits for the baseline, the comment names the step the baseline job is in, and the run records its phases', async t => {
const f = await fixture(t, 'expo-router');
t.mock.method(globalThis, 'fetch', async input => assert.fail(`Unmocked network request: ${input}`));
const baseline = await runBaselineCi({ project: f.baseProject, sha: f.baseSha, output: join(f.root, 'baseline'), config: f.config, environment: f.environment,
runner: f.runner, now: f.now, sleep: f.sleep, timingsPath: join(f.root, 'baseline-timings.jsonl') });
const finished = deferred();
const bodies = [];
const timingsPath = join(f.root, 'timings.jsonl');
let watching;
// While head captures, the baseline job moves on to its capture step, then finishes.
const runner = request => {
if (request.args[0] === 'simulator:start' && watching) {
watching.onUpdate({ state: 'in progress', step: 'Capture complete single-commit baseline', stepSince: 0, waitedMs: 60_000 });
setImmediate(() => finished.resolve(baseline.directory));
}
return f.runner(request);
};
// The waiting status's write is slow: held until the final comment has landed (or 3 s, since serialized writes send
// the final one only after it), it must still land before the final comment, not after it.
let reviewRendered = false;
const finalLanded = deferred();
const transport = async (input, init = {}) => {
const waiting = init.method === 'PATCH' && String(init.body).includes('base waits for');
if (waiting) await Promise.race([finalLanded.promise, new Promise(resolve => setTimeout(resolve, 3000))]);
const response = await f.transport(input, init);
if (init.method === 'PATCH' && !waiting && reviewRendered) finalLanded.resolve();
return response;
};
await runPublicCi({ baseProject: f.baseProject, headProject: f.headProject, pullRequestPath: f.pullRequestPath, output: join(f.root, 'review'), config: f.config,
environment: f.environment, transport, runner, now: f.now, sleep: f.sleep, timingsPath, progressPostMs: 0,
onComment: (state, body) => { bodies.push(body); if (state.review) reviewRendered = true; },
awaitBaseline: (_signal, watch) => {
watching = watch;
watch.onUpdate({ state: 'in progress', step: 'Install the launch recording decoder', stepSince: 0, waitedMs: 0 });
return finished.promise;
} });
const waiting = bodies.filter(body => body.includes("base waits for the default branch's baseline (in “Install the launch recording decoder”)"));
assert.ok(waiting.length >= 1, bodies.join('\n---\n'));
assert.equal(bodies.at(-1).includes('base waits for'), false, 'the comment stops saying so once the wait is over');
assert.equal(f.comments.at(-1).includes('base waits for'), false, 'the slow waiting write did not land after the final comment');
const events = (await readFile(timingsPath, 'utf8')).trim().split('\n').map(line => JSON.parse(line));
assert.equal(events[0].type, 'run');
assert.deepEqual(events.at(-1), { ...events.at(-1), type: 'finish', outcome: 'ok' });
const ended = events.filter(event => event.type === 'end');
const started = events.filter(event => event.type === 'start');
assert.deepEqual(started.map(event => event.id).sort(), ended.map(event => event.id).sort(), 'every span the review opened, it closed');
const phases = new Set(ended.map(event => `${event.phase}${event.side ? `:${event.side}` : ''}`));
for (const phase of ['plan', 'preflight', 'capture', 'compare', 'report', 'baseline-blocked', 'pass:head', 'configuration:head', 'session-start:head', 'route:head']) {
assert.ok(phases.has(phase), `${phase} in ${[...phases].join(', ')}`);
}
const baselineEvents = (await readFile(join(f.root, 'baseline-timings.jsonl'), 'utf8')).trim().split('\n').map(line => JSON.parse(line));
assert.ok(baselineEvents.some(event => event.type === 'end' && event.phase === 'pass' && event.side === 'baseline'));
assert.deepEqual(baselineEvents.at(-1), { ...baselineEvents.at(-1), type: 'finish', outcome: 'ok' });
});
test('the waiting status is posted when the wait starts and ends, and a step change in between waits its turn', async t => {
const f = await fixture(t, 'expo-router');
t.mock.method(globalThis, 'fetch', async input => assert.fail(`Unmocked network request: ${input}`));
const baseline = await runBaselineCi({ project: f.baseProject, sha: f.baseSha, output: join(f.root, 'baseline'), config: f.config, environment: f.environment, runner: f.runner, now: f.now, sleep: f.sleep });
const finished = deferred();
let watching;
const runner = request => {
if (request.args[0] === 'simulator:start' && watching) {
watching.onUpdate({ state: 'in progress', step: 'Capture complete single-commit baseline', stepSince: 0, waitedMs: 60_000 });
setImmediate(() => finished.resolve(baseline.directory));
}
return f.runner(request);
};
const bodies = [];
await runPublicCi({ baseProject: f.baseProject, headProject: f.headProject, pullRequestPath: f.pullRequestPath, output: join(f.root, 'review'), config: f.config,
environment: f.environment, transport: f.transport, runner, now: f.now, sleep: f.sleep, onComment: (_state, body) => bodies.push(body),
awaitBaseline: (_signal, watch) => {
watching = watch;
watch.onUpdate({ state: 'in progress', step: 'Install the launch recording decoder', stepSince: 0, waitedMs: 0 });
return finished.promise;
} });
// The step change came moments after the first post, so the wait's end replaced it before its turn: every post
// rewrites the whole comment, which the other targets' jobs write too.
assert.ok(bodies.some(body => body.includes('Install the launch recording decoder')));
assert.equal(bodies.some(body => body.includes('Capture complete single-commit baseline')), false);
assert.equal(f.comments.at(-1).includes('base waits for'), false);
});
test('capture:review waits for the baseline run ci:find-baseline named, downloads its artifact, and restores base from it', async t => {
const f = await fixture(t, 'expo-router');
t.mock.method(globalThis, 'fetch', async input => assert.fail(`Unmocked network request: ${input}`));
+1 -41
View File
@@ -6,7 +6,6 @@ import test from "node:test";
import { Uint8ArrayReader, Uint8ArrayWriter, ZipWriter, configure } from "@zip.js/zip.js";
const { waitForBaselineArtifact, awaitPendingBaseline } = await import("../../dist/ci/baseline-wait.js");
const { createTimings } = await import("../../dist/shared/timings.js");
const { findPendingBaselineRun, findOptionalBaseline } = await import("../../dist/ci/workflow-steps.js");
const sha = "a".repeat(40);
@@ -89,7 +88,6 @@ test("a baseline job in progress, then finished: the review reuses its artifact,
assert.equal(await readFile(join(directory, "screenshots/home.png"), "utf8"), "png");
assert.equal(github.polls(), 5);
assert.deepEqual(lines, [
"waiting for main's baseline run 20 of aaaaaaaa: https://github.com/acme/app/actions/runs/20",
"waiting for main's baseline run 20 of aaaaaaaa (iphone: not started, 0 min)",
"waiting for main's baseline run 20 of aaaaaaaa (iphone: queued, 0 min)",
"waiting for main's baseline run 20 of aaaaaaaa (iphone: in progress, 0 min)",
@@ -101,44 +99,6 @@ test("a baseline job in progress, then finished: the review reuses its artifact,
assert.deepEqual((await readdir(join(root, "review"))).sort(), ["baseline-download"], "the downloaded zip is removed once unpacked");
});
test("the wait names the step the baseline job is in, tells the review when it changes, and records the steps it took", async t => {
const root = await mkdtemp(join(tmpdir(), "explore-baseline-steps-"));
t.after(() => rm(root, { recursive: true, force: true }));
// The clock starts at a real date so GitHub's step timestamps and the wait's clock agree, as they do on a runner.
let milliseconds = Date.parse("2026-10-23T21:53:00Z");
const time = { now: () => milliseconds, sleep: async pause => { milliseconds += pause; } };
const at = minutes => new Date(Date.parse("2026-10-23T21:53:00Z") + minutes * 60_000).toISOString();
const steps = (current) => [
{ number: 1, name: "Set up job", status: "completed", conclusion: "success", started_at: at(0), completed_at: at(0.5) },
{ number: 2, name: "Install the launch recording decoder https://mirror.example/?sig=SIG-CANARY", status: current === 2 ? "in_progress" : "completed",
conclusion: current === 2 ? null : "success", started_at: at(0.5), completed_at: current === 2 ? null : at(19) },
...(current === 3 ? [{ number: 3, name: "Capture complete single-commit baseline", status: "in_progress", conclusion: null, started_at: at(19), completed_at: null }] : []),
];
const states = [...Array(57).fill({ jobs: [{ ...job("in_progress"), steps: steps(2) }] }), { jobs: [{ ...job("in_progress"), steps: steps(3) }] }];
const github = fakeGitHub({ states });
const updates = []; const lines = [];
const path = join(root, "timings.jsonl");
const outcome = await waitForBaselineArtifact(waitOptions(github, time, { timeoutMs: 20 * 60_000, progress: line => lines.push(line),
onUpdate: update => updates.push(update), timings: createTimings({ path, now: time.now }) }));
assert.deepEqual(outcome, { reason: "its iphone job is still in progress after 20 min" });
assert.deepEqual(updates.map(update => [update.state, update.step]), [
["in progress", "Install the launch recording decoder [link]"],
["in progress", "Capture complete single-commit baseline"],
]);
assert.equal(updates[0].stepSince, Date.parse(at(0.5)));
assert.ok(lines.includes("waiting for main's baseline run 20 of aaaaaaaa (iphone: in progress, in \"Install the launch recording decoder [link]\" for 9 min, 9 min)"), lines.join("\n"));
const events = (await readFile(path, "utf8")).trim().split("\n").map(line => JSON.parse(line));
assert.deepEqual(events.filter(event => event.type === "baseline-step").map(event => [event.name, Math.round(event.ms / 1000), event.conclusion]), [
["Set up job", 30, "success"],
["Install the launch recording decoder [link]", 1110, "success"],
["Capture complete single-commit baseline", 60, "still running"],
]);
const wait = events.find(event => event.type === "end" && event.phase === "baseline-wait");
assert.equal(wait.outcome, "skipped");
assert.equal(wait.attributes.reason, "its iphone job is still in progress after 20 min");
assert.equal(JSON.stringify(events).includes("SIG-CANARY"), false);
});
test("this target's artifact is reused although another target's baseline job failed (#48)", async () => {
const github = fakeGitHub({ states: [{ jobs: [job("completed", "failure", "duo-open"), job("in_progress")] },
{ runStatus: "completed", conclusion: "failure", jobs: [job("completed", "failure", "duo-open"), job("completed", "success")], artifact: true }] });
@@ -175,7 +135,7 @@ test("the wait gives up at its time limit, polling every 20 s", async () => {
assert.deepEqual(await waitForBaselineArtifact(waitOptions(github, time, { progress: line => lines.push(line) })), { reason: "its iphone job is still in progress after 15 min" });
assert.equal(time.elapsed(), 15 * 60_000);
assert.equal(github.polls(), 15 * 3 + 1);
assert.equal(lines.length, 1 + 15, "the run's link once, then one line a minute, not one a poll");
assert.equal(lines.length, 15, "one line a minute, not one a poll");
assert.deepEqual(await waitForBaselineArtifact(waitOptions(fakeGitHub({ states: [{ jobs: [job("in_progress")] }] }), clock(), { timeoutMs: 50_000, pollMs: 30_000 })),
{ reason: "its iphone job is still in progress after 1 min" }, "the last pause ends at the limit");
});
-44
View File
@@ -1,44 +0,0 @@
import assert from "node:assert/strict";
import test from "node:test";
import { Worker } from "node:worker_threads";
const { settleCaptureWorker } = await import("../../dist/ci/capture-worker.js");
// A worker that names a blocking call, then really blocks its thread in a synchronous subprocess, as a capture's
// install or native build does, and reports its result a little after the call returns.
const blockingWorker = `
const { parentPort } = require("node:worker_threads");
const { spawnSync } = require("node:child_process");
parentPort.postMessage({ type: "progress", message: "installing the app" });
parentPort.postMessage({ type: "blocking", phase: "install", boundMs: 15 * 60000 });
spawnSync("sleep", ["0.8"]);
parentPort.postMessage({ type: "unblocked" });
setTimeout(() => parentPort.postMessage({ type: "done", result: { outputDirectory: "/out" } }), 400);
`;
test("while a capture worker is blocked in a call it named, the parent prints a line on its own, and stops when the call returns", async () => {
const lines = [];
const started = Date.now();
const result = await settleCaptureWorker(new Worker(blockingWorker, { eval: true }), { side: "head", appearancePass: { all: ["light", "dark"], capture: ["dark"] } },
line => lines.push({ line, at: Date.now() - started }), undefined, 100);
assert.deepEqual(result, { outputDirectory: "/out" });
assert.equal(lines[0].line, "installing the app");
const beats = lines.slice(1);
assert.ok(beats.length >= 4, `heartbeats while blocked: ${JSON.stringify(lines)}`);
assert.match(beats[0].line, /^head dark: still in install \(\d+ ms of at most 15 min\)$/);
// None after the call returned: the last 400 ms before the result are quiet.
assert.ok(beats.at(-1).at < Date.now() - started - 250, JSON.stringify(lines));
});
test("a baseline's worker is named as its timings are, not by the head side it captures as", async () => {
const lines = [];
await settleCaptureWorker(new Worker(blockingWorker, { eval: true }), { side: "head", timingsSide: "baseline" }, line => lines.push(line), undefined, 100);
assert.match(lines[1], /^baseline: still in install /);
});
test("a worker that names no blocking call gets no heartbeat, and its failure still settles the capture", async () => {
const lines = [];
const worker = new Worker(`require("node:worker_threads").parentPort.postMessage({ type: "error", error: { code: "CAPTURE_INSTALL_FAILED", stage: "session", message: "m", nextAction: "n", retryable: false } });`, { eval: true });
await assert.rejects(settleCaptureWorker(worker, { side: "base" }, line => lines.push(line), undefined, 50), error => error.code === "CAPTURE_INSTALL_FAILED");
assert.deepEqual(lines, []);
});
+1 -15
View File
@@ -6,7 +6,7 @@ import { spawnSync } from "node:child_process";
import test from "node:test";
import { tsImport } from "tsx/esm/api";
const { CiError, toCiError, ciErrorForCommand, serializeCiError, renderCiErrorAnnotation, renderCiErrorSummary, reportCiError, redactSecrets } =
const { CiError, toCiError, ciErrorForCommand, serializeCiError, renderCiErrorAnnotation, renderCiErrorSummary, reportCiError } =
await tsImport("../../src/shared/ci-errors.ts", import.meta.url);
const { executeCaptureSetup } = await tsImport("../../src/capture/setup-actions.ts", import.meta.url);
const { createExplorationInputs } = await tsImport("../../src/config/exploration-inputs.ts", import.meta.url);
@@ -65,20 +65,6 @@ test("diagnostics redact explicit secrets, credential fields, bearer tokens, sig
assert.equal("stack" in serializeCiError(error), false);
});
test("the redactor removes a session's fragment token and object-store signatures and credentials", () => {
const text = [
"https://expo.dev/accounts/a/projects/b/simulator-sessions/1#token=FRAGMENT-CANARY&x=1",
"https://bucket.s3.amazonaws.com/a?X-Amz-Credential=CREDENTIAL-CANARY&X-Amz-Signature=SIGNATURE-CANARY&X-Amz-Security-Token=SESSION-CANARY",
"https://storage.googleapis.com/a?X-Goog-Signature=GOOG-CANARY",
"https://blob.core.windows.net/a?sv=2024&se=EXPIRY-CANARY&sig=SIG-CANARY",
].join(" ");
const redacted = redactSecrets(text, []);
for (const canary of ["FRAGMENT-CANARY", "CREDENTIAL-CANARY", "SIGNATURE-CANARY", "SESSION-CANARY", "GOOG-CANARY", "EXPIRY-CANARY", "SIG-CANARY"]) {
assert.equal(redacted.includes(canary), false, canary);
}
assert.match(redacted, /simulator-sessions\/1#token=\[REDACTED\]&x=1/);
});
test("diagnostics redact raw, JSON-escaped, and URL-encoded secret values throughout structured errors", () => {
const secret = 'review"P\\ass/word+9';
const variants = [secret, JSON.stringify(secret).slice(1, -1), encodeURIComponent(secret)];
-6
View File
@@ -107,12 +107,6 @@ test('a started run is known by its JSON or by the link it printed, and a start
assert.throws(() => hostedRepackRunStart('', 'Failed to upload project sources.\nError: socket hang up\n', 'ios'),
error => error.code === 'EAS_REPACK_FAILED' && hostedRepackRetries(error) === 2 && /did not start the hosted ios repack/.test(error.message));
assert.throws(() => hostedRepackRunStart('', 'Error: Not logged in\n', 'ios'), error => hostedRepackRetries(error) === 0);
// The link is written to logs and errors: only the page, never a query or fragment eas-cli appended to it.
assert.deepEqual(hostedRepackRunStart(JSON.stringify({ id: '01a15b61-c4a2-7c7b-b950-9f280edea954', url: `${url}?token=SECRET#frag` }), '', 'ios'),
{ id: '01a15b61-c4a2-7c7b-b950-9f280edea954', url });
const failed = (() => { try { hostedRepackBuildId(JSON.stringify({ status: 'FAILURE', logURL: `${url}?sig=SECRET`, jobs: [{ key: 'repack', status: 'FAILURE' }] }), '', 'ios'); } catch (error) { return error; } })();
assert.equal(failed.details.logs, url);
assert.equal(JSON.stringify(failed).includes('SECRET') || failed.nextAction.includes('SECRET'), false);
});
test('the staged digest changes with any file, mode or link, and the share key with every input', async t => {
-14
View File
@@ -192,20 +192,6 @@ test('pending and capturing runs say what they are doing in the heading and a li
assert.equal(progress('head', false), `iOS · capturing head 1/3 · ${runLink}`);
assert.equal(progress('head', true), `iOS · capturing head 1/3 · base reused · ${runLink}`);
assert.equal(progress(undefined, false), `iOS · capturing head 1/3 · ${runLink}`);
// Base waiting for the default branch's baseline says so, with the step that baseline job is in, until the wait ends.
const waitingState = step => state({ phase: 'capturing', links, review: undefined, evidence: undefined,
capture: { planned: { base: 3, head: 3 }, done: { base: 0, head: 3 }, baseFromCache: false, current: 'head', waiting: { on: 'baseline', ...(step ? { step } : {}) } } });
assert.equal(statusOf(renderPublicComment(waitingState('Install the launch recording decoder')), 'iOS'),
`iOS · head 3/3 · base waits for the default branch's baseline (in “Install the launch recording decoder”) · ${runLink}`);
assert.equal(statusOf(renderPublicComment(waitingState()), 'iOS'), `iOS · head 3/3 · base waits for the default branch's baseline · ${runLink}`);
assert.equal(statusOf(renderPublicComment(waitingState('a *bold* [link](x)')), 'iOS'),
`iOS · head 3/3 · base waits for the default branch's baseline (in “a \\*bold\\* \\[link\\]\\(x\\)”) · ${runLink}`, 'a step name is text, not Markdown');
// Another target's writer re-renders this record from the comment it read: the wait survives, and a record from
// before it existed still parses.
const record = parsePlatformRecord(JSON.parse(JSON.stringify(platformRecordOf(waitingState('Install the launch recording decoder')))));
assert.deepEqual(record.capture.waiting, { on: 'baseline', step: 'Install the launch recording decoder' });
const older = platformRecordOf(waitingState()); delete older.capture.waiting;
assert.equal(parsePlatformRecord(JSON.parse(JSON.stringify(older))).capture.waiting, undefined);
assert.equal(titleOf(renderPublicComment(state({ phase: 'capturing', links, review: undefined, evidence: undefined }))), '### Explore review · capturing');
const none = renderPublicComment(state({ review: review([surface('cats', 'modified', { extra: { review: { status: 'unchanged', description: 'No visible change' } } })]) }));
assert.equal(titleOf(none), `### No screens changed · [Review in Explore](<${reportUrl}>)`, 'unchanged surfaces are no change');
-120
View File
@@ -1,120 +0,0 @@
import assert from "node:assert/strict";
import { mkdtemp, readFile, rm } from "node:fs/promises";
import { tmpdir } from "node:os";
import { join } from "node:path";
import test from "node:test";
import { tsImport } from "tsx/esm/api";
const { createTimings, silentTimings, blockingCall, throttledProgress, githubRunLink, easPageLink, safeText, renderTimingsSummary, formatDuration } =
await tsImport("../../src/shared/timings.ts", import.meta.url);
const { CiError } = await tsImport("../../src/shared/ci-errors.ts", import.meta.url);
async function withFile(run) {
const directory = await mkdtemp(join(tmpdir(), "explore-timings-"));
try { return await run(join(directory, "explore-diagnostics", "timings.jsonl")); }
finally { await rm(directory, { recursive: true, force: true }); }
}
const events = async path => (await readFile(path, "utf8")).trim().split("\n").map(line => JSON.parse(line));
test("a span is written when it opens and when it closes, with its labels, duration and outcome", () => withFile(async path => {
let clock = 1_000;
const timings = createTimings({ path, now: () => clock }).labelled({ side: "head", pass: "dark" });
const end = timings.span("repack", { attempt: 1 });
clock += 2_500;
end("ok", { build: "abc" });
end("failed");
const [start, finish, ...rest] = await events(path);
assert.deepEqual(start, { type: "start", id: start.id, phase: "repack", at: 1_000, side: "head", pass: "dark", attributes: { attempt: 1 } });
assert.deepEqual(finish, { type: "end", id: start.id, phase: "repack", at: 3_500, ms: 2_500, outcome: "ok", side: "head", pass: "dark", attributes: { attempt: 1, build: "abc" } });
assert.equal(rest.length, 0, "a span closes once");
}));
test("measure ends a span ok, failed with the error's code, or cancelled, for sync and async work", () => withFile(async path => {
const timings = createTimings({ path });
assert.equal(timings.measure("plan", () => 4), 4);
assert.equal(await timings.measure("compare", async () => 5), 5);
assert.throws(() => timings.measure("install", () => { throw new CiError({ code: "INSTALL_FAILED", stage: "s", message: "m", nextAction: "n" }); }));
await assert.rejects(timings.measure("session-start", async () => { throw new CiError({ code: "CAPTURE_CANCELLED", stage: "s", message: "m", nextAction: "n" }); }));
const ends = (await events(path)).filter(event => event.type === "end");
assert.deepEqual(ends.map(event => [event.phase, event.outcome, event.attributes?.code]),
[["plan", "ok", undefined], ["compare", "ok", undefined], ["install", "failed", "INSTALL_FAILED"], ["session-start", "cancelled", "CAPTURE_CANCELLED"]]);
}));
test("a recorder that cannot write never fails the capture it times", () => {
const timings = createTimings({ path: "/dev/null/not-a-directory/timings.jsonl" });
assert.equal(timings.measure("plan", () => "done"), "done");
timings.record({ type: "finish", outcome: "ok" });
assert.equal(silentTimings.measure("plan", () => 1), 1);
});
test("nothing a recorder writes carries a secret, a signed link or a session's fragment token", () => withFile(async path => {
const secret = "expo-token-CANARY-1234567890";
const timings = createTimings({ path, secrets: [secret] });
timings.record({ type: "baseline-step", name: `Install ${secret} https://x.example/a#token=FRAGMENT-CANARY`, ms: 1, conclusion: "success" });
timings.span("repack", { note: "https://bucket.s3.amazonaws.com/a?X-Amz-Signature=SIGNATURE-CANARY", other: `?sig=SIG-CANARY ${secret}` })();
const text = await readFile(path, "utf8");
for (const canary of ["CANARY-1234567890", "FRAGMENT-CANARY", "SIGNATURE-CANARY", "SIG-CANARY"]) assert.equal(text.includes(canary), false, canary);
const summary = renderTimingsSummary(text);
for (const canary of ["CANARY-1234567890", "FRAGMENT-CANARY"]) assert.equal(summary.includes(canary), false, canary);
}));
test("safe text has no links, one line and a bounded length", () => {
assert.equal(safeText("Install the launch\nrecording decoder"), "Install the launch recording decoder");
assert.equal(safeText("see https://expo.dev/a?b=c for logs"), "see [link] for logs");
assert.equal(safeText("x".repeat(200)).length, 80);
});
test("a wait's heartbeat prints at once, then at most once a minute", () => {
let clock = 0;
const lines = [];
const tick = throttledProgress(line => lines.push(`${clock}:${line}`), { now: () => clock });
for (clock of [0, 20_000, 40_000, 59_999, 60_000, 80_000, 119_999, 120_000]) tick("waiting");
assert.deepEqual(lines, ["0:waiting", "60000:waiting", "120000:waiting"]);
});
test("a blocking call is timed with its bound and tells the notice when it starts and ends", () => withFile(async path => {
const told = [];
const notice = (phase, boundMs) => { told.push(["start", phase, boundMs]); return () => told.push(["end"]); };
assert.equal(blockingCall(createTimings({ path }), notice, "native-build", 45 * 60_000, () => "built"), "built");
assert.throws(() => blockingCall(createTimings({ path }), notice, "install", 1000, () => { throw new Error("failed"); }));
assert.deepEqual(told, [["start", "native-build", 2_700_000], ["end"], ["start", "install", 1000], ["end"]]);
const ends = (await events(path)).filter(event => event.type === "end");
assert.deepEqual(ends.map(event => [event.phase, event.outcome]), [["native-build", "ok"], ["install", "failed"]]);
}));
test("links are rebuilt from their validated parts, never copied", () => {
const environment = { GITHUB_SERVER_URL: "https://github.com", GITHUB_REPOSITORY: "brentvatne/euxy" };
assert.equal(githubRunLink(environment, 40029888046), "https://github.com/brentvatne/euxy/actions/runs/40029888046");
assert.equal(githubRunLink(environment, "1?x=y"), undefined);
assert.equal(githubRunLink({ ...environment, GITHUB_REPOSITORY: "a/b/../c?d" }, 1), undefined);
assert.equal(easPageLink("https://expo.dev/accounts/brent/projects/euxy/workflows/01ABC-def?token=x#y", "workflows"),
"https://expo.dev/accounts/brent/projects/euxy/workflows/01ABC-def");
// eas-cli's "See logs: <link>." brings the full stop along.
assert.equal(easPageLink("https://expo.dev/accounts/brent/projects/euxy/workflows/01ABC-def.", "workflows"),
"https://expo.dev/accounts/brent/projects/euxy/workflows/01ABC-def");
for (const value of ["https://evil.dev/accounts/a/projects/b/workflows/c", "https://user:[email protected]/accounts/a/projects/b/workflows/c",
"https://expo.dev/accounts/a/projects/b/builds/c", "https://expo.dev/accounts/a/projects/b/simulator-sessions/c", "http://expo.dev/accounts/a/projects/b/workflows/c", "not a url", undefined]) {
assert.equal(easPageLink(value, "workflows"), undefined, String(value));
}
});
test("the summary totals phases per side, describes the routes, and names spans the job never finished", () => withFile(async path => {
let clock = 0;
const timings = createTimings({ path, now: () => clock });
timings.record({ type: "run", target: "iphone" });
const head = timings.labelled({ side: "head" });
for (const [route, ms] of [["/a", 1_000], ["/b", 2_000], ["/c", 3_000], ["/d", 10_000]]) { const end = head.span("route", { route }); clock += ms; end(); }
const repack = head.span("repack"); clock += 90_000; repack();
timings.labelled({ side: "base" }).span("session-start");
clock += 5_000;
timings.record({ type: "baseline-step", name: "Install the launch recording decoder", ms: 19 * 60_000, conclusion: "cancelled" });
const summary = renderTimingsSummary(await readFile(path, "utf8"));
assert.match(summary, /### Explore capture timings · iphone/);
assert.match(summary, /\| repack \| head \| 1 \| 1 min 30 s \| 1 min 30 s \|/);
assert.match(summary, /\*\*Routes:\*\* 4, median 2 s, p90 10 s; slowest \/d 10 s, \/c 3 s, \/b 2 s\./);
assert.match(summary, /- Install the launch recording decoder: 19 min \(cancelled\)/);
assert.match(summary, /\*\*Never finished\*\* \(the job ended first\): session-start \(base\), 5 s\+/);
assert.match(summary, /no finish recorded/);
assert.equal(renderTimingsSummary(""), "");
assert.equal(formatDuration(850), "850 ms");
}));