Add conformance CI workflow (fault + prod lanes) [DEV-1159] - #7
Merged
Conversation
Runs the raindrop-sdk-harness against the Go conformance driver (conformance/, DEV-1144) on every pull request, mirroring the hardened pattern from python-sdk/raindrop-js/java-sdk: - fault-lane: local capture/fault server only, no credentials beyond the HARNESS_READ_TOKEN org secret; loud fork-safe skip. - prod-lane: real Raindrop ingest + Query API via org secrets (RAINDROP_WRITE_KEY / RAINDROP_QUERY_API_KEY), step-scoped env, loud skip when secrets are unavailable. - Harness pinned to invisible-tools/raindrop-sdk-harness@b162d84a (main @ 2026-07-13); bump procedure documented in the header. - Actions SHA-pinned, persist-credentials: false, concurrency cancel-in-progress, 15min timeouts, continue-on-error while the suite beds in, report JSON artifact + job summary per lane. DEV-1159 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
New scenarios since the previous pin (wrap-capture-attachments, the three expect.traces span scenarios) are all status: experimental — they report but never gate, so no ratchet changes are needed. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
rsd-raindrop
approved these changes
Jul 13, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds
.github/workflows/conformance.yml(DEV-1159): per-PR conformance CI running the raindrop-sdk-harness against this repo's Go conformance driver (conformance/, DEV-1144). Mirrors the hardened workflow already landed in python-sdk, raindrop-js, and java-sdk.Two lanes
go build -o conformance/driver ./conformance), starts the harness's local capture/fault server, and runs the full scenario corpus against it. No production calls; the only secret involved is theHARNESS_READ_TOKENorg secret used to check out the private harness repo, with a loud fork-safe skip when it's unavailable.RAINDROP_WRITE_KEY/RAINDROP_QUERY_API_KEYorg secrets (dedicated test org). Endpoints and credentials are scoped to the single step that needs them; skips loudly when secrets are missing.Hardening (same pattern as the sibling SDKs)
invisible-tools/raindrop-sdk-harness@b162d84a4c25b7203173f99e595de7ba88a57960(main @ 2026-07-13, 27 scenarios); the bump procedure is documented in the workflow header.persist-credentials: falseon every checkout;permissions: contents: read; concurrency group withcancel-in-progress; 15-minute job timeouts.continue-on-error: trueon the runner steps while the suite beds in (non-blocking); each lane uploads a report JSON artifact and writes a full job summary. Ratchet baseline is the existingconformance/failures.txt.actions/setup-gousescache: false— the module is stdlib-only with nogo.sum, which the cache otherwise hard-fails on.Notes
🤖 Generated with Claude Code