Skip to content

feat(fullsend): add CI triage agent and repair loop - #4567

Open
divyanshiGupta wants to merge 1 commit into
redhat-developer:mainfrom
divyanshiGupta:ci-agent
Open

feat(fullsend): add CI triage agent and repair loop#4567
divyanshiGupta wants to merge 1 commit into
redhat-developer:mainfrom
divyanshiGupta:ci-agent

Conversation

@divyanshiGupta

@divyanshiGupta divyanshiGupta commented Sep 3, 2026

Copy link
Copy Markdown
Member

Summary

Add an autonomous Fullsend CI/E2E triage and repair loop for RHDH Plugins.

What changed

  • Add trusted intake for completed CI workflow runs.
  • Resolve the matching open PR and verify its current head SHA.
  • Identify failed leaf jobs and affected workspaces.
  • Upload and analyze Jest and Playwright failure evidence.
  • Add a read-only ci-triage agent using the retro role.
  • Classify failures as code, test, flaky, infrastructure, or unknown.
  • Retry high-confidence flaky failures once.
  • Reuse the existing Fullsend fix agent through a CI-specific repair harness.
  • Restrict repairs to the affected workspace.
  • Require targeted verification before committing.
  • Add host-side checks for stale heads, unsafe paths, secrets, oversized diffs, and non-fast-forward pushes.
  • Add deduplication markers, concurrency controls, repair limits, and needs-human escalation.
  • Keep forks diagnosis-only and support fullsend-no-fix as a kill switch.
  • Add observe/repair/off rollout controls.

Safety

The agents never push directly. All mutations are performed only after deterministic host-side validation confirms that:

  • The PR is still open and unchanged.
  • The repair is limited to one approved workspace.
  • The diff is within configured limits.
  • Secret scanning passes.
  • Required verification succeeds.
  • The push can be performed as a fast-forward update.

Rollout

The automation defaults to observe mode. Repairs can be enabled gradually with:
FULLSEND_CI_AUTOMATION=repair
FULLSEND_CI_AUTOFIX_WORKSPACES=boost,scorecard,ai-integrations
Set FULLSEND_CI_AUTOMATION=off to disable the loop immediately.

Testing

  • CI context and trust-boundary tests
  • Schema fixture validation
  • Diff guard tests
  • Post-script safety tests
  • Workflow YAML and permission checks
  • Bash syntax checks
    yarn test:ci-agent passes.

✔️ Checklist

  • A changeset describing the change and affected packages. (more info)
  • Added or Updated documentation
  • Tests for new functionality and regression tests for bug fixes
  • Screenshots attached (for UI changes)

@divyanshiGupta
divyanshiGupta requested review from a team as code owners September 3, 2026 14:47
Comment thread .github/workflows/fullsend-ci-repair.yml Fixed
Comment thread .github/workflows/fullsend-ci-triage.yml Fixed
@divyanshiGupta
divyanshiGupta force-pushed the ci-agent branch 2 times, most recently from 42289da to be9e88c Compare September 3, 2026 16:41
@sonarqubecloud

sonarqubecloud Bot commented Sep 3, 2026

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants