Files
Federico EliaandClaude Opus 5 5a77154ff5 Six test applications on real postings, and the facts they settled
JazzHR, BambooHR, Personio, Breezy, Teamtailor and Greenhouse, each on a
real posting with the test CV, nothing sent: 8 to 48 steps, under a cent
to a cent each. Five of the unknowns the plugins admitted to are now
facts.

The one worth saying once: a file input the page hides refuses the file,
and the upload goes to the button beside it, which the page labels. It
happened on Greenhouse and on Personio in the same run, so it is in the
rules every form gets, and each plugin keeps its own selector:
`[aria-labelledby='upload-label-resume'] button` on Greenhouse,
`[aria-labelledby="doc-label-cv"] button` on Personio, `a.resume` on
Breezy, `#resumator-resume-value` on JazzHR.

Also settled: a closed BambooHR posting sends the browser to the
company's whole list at /careers, which is that plugin's missing
closed-posting fact; Personio's company questions are
`#field-custom_attribute_<number>` and its send control is
`form button[type="submit"]`, with the page in English on some .com
postings; Breezy's send control is a `type="button"` and uploading fills
its summary field; Teamtailor's cookie banner is declined by its
aria-label in the page's language.

docs/sites.md records each run with its steps.

Co-Authored-By: Claude Opus 5 <[email protected]>
2026-11-07 13:21:27 +01:00

38 lines
6.4 KiB
Markdown

# Sites: what to expect
What AIHawk can do on each site, from the real forms it has been run on. Postings are counted by host in the job index (`index.parquet` in the release built 2026-11-04) and rounded to the nearest thousand.
| Site | Postings in the index | Status | What stops it |
|---|---|---|---|
| Greenhouse (boards and job-boards hosts, EU too) | ~200k | sent and confirmed on a real form | One real send (one send only). Others stopped at required questions the CV and answers do not cover. A dry run on 2026-11-07 met a closed posting and said so in 33 seconds: the board sends a closed job to `/<company>?error=true`, which the plugin now names. |
| Ashby (jobs.ashbyhq.com) | ~76k | sent and confirmed on a real form | One real send (one send only). Others stopped at required questions, or found a closed posting, or a Submit button that stayed disabled. A dry run on 2026-11-07 with a test CV filled the form in 40 steps and found the send control, which no id names. |
| Lever (jobs.lever.co, jobs.eu.lever.co) | ~101k | sent and confirmed on a real form | One real send through the app as it is now: the page said "Application submitted!" at an address ending in `/thanks`. A dry run on 2026-11-07 with a test CV filled the form in 22 steps, the cheapest of any site, with no captcha shown. |
| JazzHR (applytojob.com) | ~154k | stops at a captcha most of the time | reCAPTCHA did not pass with a click on 5 postings; it often turned into an image puzzle. A later run, with no limit on clicks: the whole form filled in about 2 minutes, then the same image puzzle. A dry run on 2026-11-07 with a test CV filled a real form in 24 steps and under a cent, with no captcha shown on that posting, and settled where the CV goes. |
| BambooHR (bamboohr.com) | ~87k | stops at a captcha most of the time | reCAPTCHA did not pass with a click on 5 postings; it often turned into an image puzzle. A later run reached the send button in about 5 minutes with no captcha shown; whether one shows on sending is not known. No send has gone. A dry run on 2026-11-07 met a closed posting and said so in 8 steps: a closed job sends the browser to the company's whole list at `/careers`. |
| Personio (jobs.personio.de, jobs.personio.com) | ~64k | stops at a captcha about half the time | Turnstile passed on 2 of 4 postings. A real form ended blocked. A dry run on 2026-11-07 with a test CV filled a real form in 22 steps and under a cent, on an English `.com` posting, and settled the CV control and the send control. |
| SmartRecruiters (jobs.smartrecruiters.com) | ~519k | reaches the send button, not always | One real form filled through every step in about 11 minutes, and the send button named. A later run stopped at 150 steps, pressing keys that scrolled nothing; with a rule against that, the next two runs reached the button, in about 10 and 7 minutes. No send has gone. A dry run on 2026-11-07 with a test CV filled the two-step form in 42 steps and 6 minutes, send control found, nothing sent. |
| Recruitee (recruitee.com) | ~26k | sent and confirmed on a real form | One real send (one send only). Other forms stopped at required questions that test answers do not fit. |
| Teamtailor (teamtailor.com) | ~30k | sent and confirmed on a real form | One real send (one send only). An earlier click was refused for its test phone number, so nothing went then. Other forms stopped at required questions. A dry run on 2026-11-07 with a test CV filled a real form in 41 steps and a cent, in Italian; the phone's "Edit number" button refused a click. |
| Workable (apply.workable.com) | ~35k | send clicked, not confirmed | One real form filled and sent: the button stayed on "Submitting…" beside an unticked Cloudflare box, and the browser was closed with no answer from the page. A dry run on 2026-11-07 with a test CV filled the form in 27 steps and under 3 minutes, send control found, nothing sent; a second posting had closed, and the model said so. |
| Paylocity (recruiting.paylocity.com) | ~228k | reaches the send button, not always | One real form of 5 steps filled in about 27 minutes, and the send button named. A later run stopped at 150 steps, and the next two reached the button, in about 10 and 8 minutes. No send has gone. A dry run on 2026-11-07 with a test CV filled all four steps and found the send control, at 148 of the 150 steps allowed, 23 minutes: the demographic lists took most of them, and the plugin now says how to work them. |
| Breezy (breezy.hr) | ~50k | sent and confirmed on a real form | One real send (one send only). A dry run on 2026-11-07 with a test CV filled a real form in 29 steps and a cent, and settled the CV link and the send control, which is a `type="button"`. |
| Workday (myworkdayjobs.com, myworkdaysite.com) | ~1,481k | plugin written, not yet run on a real form | Needs an account on each company's site. The plugin was written from a real site read on 2026-11-07 up to the "Create Account" page: it signs in or creates the account with the candidate's email and a Workday password from the answers, and reads a verification code from the mail when the site asks for one. The steps after sign-in come from Workday's usual form, not from a run. |
| iCIMS (icims.com) | ~622k | tried, no plugin | Needs an account: a form stops at the sign-in unless you are signed in. Not tried on a real form. |
Postings per status, in the index: sent and confirmed ~484k; reaches the send button, no send confirmed ~782k; stops at a captcha most or half of the time ~305k; tried with no plugin ~2,103k.
Notes:
- A form no longer stops at what the CV does not say. Lever's send was made after that change; the others behind "sent and confirmed" were made before it, when other forms on those sites stopped at required questions.
- "Sent and confirmed" rests on one send per site. Treat it as "it can send", not "it sends reliably".
- Greenhouse's confirmation page was not saved, so its plugin keeps generic wording. Ashby's, Breezy's, Recruitee's and Teamtailor's are quoted in their plugins.
- A captcha shown as a box is clicked, as a person would. It is not solved: on a puzzle the form stops as blocked, for the person to do by hand.
## Measured
| What | Result |
|---|---|
| Ranking, graded blind on real postings | nDCG@10 of 0.683, against 0.569 before Jev; 0.4 wrong jobs in the top 10 |
| Form model, on a local course of hard forms, of 100 | DeepSeek v4.1 flash 87, GLM 83, Gemini 81 |
| A form, on real sites | 0.4 to 3.3 cents in model calls; 3 to 27 minutes |