Wire Bellwether Ingest Action - #237
Conversation
…kflows Two hardening changes before this goes near main. Pin `bellwether-run/ingest-action@v1` to its current commit SHA (92000d98..., v1.0.0). This job runs on `workflow_run`, which executes in the base repo's context with access to repo secrets — that is what lets it read runs triggered from fork PRs, and it means whatever the step resolves to can see BELLWETHER_TOKEN. `@v1` is a mutable tag the upstream owner can repoint at any commit at any time; a SHA cannot be repointed. Bump it deliberately. Scope `workflows:` to ["CI", "Integration"] instead of "*". Release and Changesets don't run tests, so there is nothing in them for Bellwether to classify and no reason to hand the action their run context. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
@jcast90 confirmed he signed up for Bellwether, so keeping this — with two hardening changes pushed to the branch. 1. Pinned the action to a commit SHA. This job runs on 2. Scoped
Ping me once it's in and I'll merge. |
Bellwether — Test Failure Ingest
This PR wires the
Bellwether Ingest Action
into your CI so failed test runs flow into the Bellwether triage inbox with
full per-test detail (stack traces, assertion messages, test names).
BELLWETHER_TOKENrepo secret BEFORE mergingThe workflow reads
${{ secrets.BELLWETHER_TOKEN }}to authenticateuploads to the Bellwether API. Without it, the action runs but every
upload fails with a 401.
https://bellwether.run/onboarding/ingest-action
New repository secret with name
BELLWETHER_TOKEN.What this changes
.github/workflows/bellwether-ingest.ymlworkflow_run: completedfor failed runs across all workflowsWhy
Without this: test failures land in the Bellwether inbox with no
per-test detail, the classifier can't tell regressions from flakes, and
every failure gets stuck at "Needs Review."
With this: classifier sees JUnit / Playwright JSON, predictions land
above the confidence threshold, the inbox surfaces the actual triage
signal.
Safe to merge as-is once the secret is set. Customize the
branchesfilter, the
if:predicate, or the action version any time — Bellwetherreads from whichever workflow file is named
bellwether-ingest.yml.Manage your install at https://bellwether.run.
🤖 Created automatically by Bellwether on repo connect (BEL-90). Closing
this PR is fine — Bellwether will fall back to the per-failure
"Set up Ingest Action" CTA.