Skip to content

Update bulk-import workspace to commit ada985e for backstage 1.54.6 on branch main - #3077

Closed
github-actions[bot] wants to merge 3 commits into
mainfrom
workspaces/main__bulk-import
Closed

github-actions[bot] wants to merge 3 commits into
mainfrom
workspaces/main__bulk-import

Conversation

@github-actions

@github-actions github-actions Bot commented Aug 1, 2026 •

Copy link
Copy Markdown
Contributor

Update bulk-import workspace at commit redhat-developer/rhdh-plugins@ada985e for backstage 1.54.6 on branch main.

This PR was created automatically.
Click on the following link to see the source diff it introduces: redhat-developer/rhdh-plugins@97a6e3a...ada985e.

Before merging, you need to export the workspace dynamic plugins as OCI images,
and if possible test them inside a RHDH instance.

To do so, you can use the /publish instruction in a PR review comment.
This will start a PR check workflow to:

  • export the workspace plugins as dynamic plugins,
  • publish them as OCI images
  • push the oci-images in the GitHub container registry with a PR-specific tag.

@openshift-ci

openshift-ci Bot commented Aug 1, 2026

Copy link
Copy Markdown

Hi @github-actions[bot]. Thanks for your PR.

I'm waiting for a redhat-developer member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work.

Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@sonarqubecloud

sonarqubecloud Bot commented Aug 1, 2026

Copy link
Copy Markdown

@its-mitesh-kumar

Copy link
Copy Markdown
Member

/ok-to-test

@its-mitesh-kumar

Copy link
Copy Markdown
Member

/publish

@github-actions github-actions Bot added mandatory-workspace PR affects a workspace with required plugins for releases workspace-update PR modifies files in an existing workspace labels Aug 1, 2026
@github-actions

github-actions Bot commented Aug 1, 2026

Copy link
Copy Markdown
Contributor Author

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import:pr_3077__8.0.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import-backend:pr_3077__8.0.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

github-actions Bot commented Aug 1, 2026

Copy link
Copy Markdown
Contributor Author

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import:pr_3077__8.0.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import-backend:pr_3077__8.0.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

github-actions Bot commented Aug 1, 2026

Copy link
Copy Markdown
Contributor Author

✅ Smoke tests workflow passed. All plugins loaded successfully.

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - bulk-import

Platform: ocp 4.20 | RHDH Version: 1.11 | Duration: 14m 26s
Passed: 0 | Failed: 3 | Flaky: 0 | Skipped: 9
Playwright Report | Build Log | Logs | Artifacts

@its-mitesh-kumar

Copy link
Copy Markdown
Member

/test e2e-ocp-helm

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - bulk-import

Platform: ocp 4.20 | RHDH Version: 1.11 | Duration: 14m 54s
Passed: 0 | Failed: 3 | Flaky: 0 | Skipped: 9
Playwright Report | Build Log | Logs | Artifacts

@hopehadfield

Copy link
Copy Markdown
Member

/update-versions

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor Author

Update Versions workflow has completed with failure.

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor Author

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import:pr_3077__8.0.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import-backend:pr_3077__8.0.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.52.0).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor Author

✅ Smoke tests workflow passed. All plugins loaded successfully.

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests - bulk-import

Platform: ocp 4.20 | RHDH Version: 1.11 | Duration: 13m 58s
Passed: 0 | Failed: 3 | Flaky: 0 | Skipped: 9
Playwright Report | Build Log | Logs | Artifacts

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

A new workspace commit d89a1571bb8a762d2d0f9b432589ec29f34f17a0 has been discovered (match type: 'exact').
You can update this PR with the latest discovered workspace source commit.

To do so, you can use the /update-commit instruction in a PR review comment.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

The versions.json file in your PR doesn't match the one in release branch main
Try updating it by adding the /update-versions PR comment.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

Publish workflow — blocked: versions.json is not up-to-date with the base branch.

@rhdh-gh-app rhdh-gh-app Bot added the ci-diagnose Triggers the fullsend ci-diagnose agent label Sep 9, 2026
@PatAKnight

Copy link
Copy Markdown
Member

/update-commit

@github-actions github-actions Bot changed the title Update bulk-import workspace to commit 7b0ac98 for backstage 1.52.0 on branch main Update bulk-import workspace to commit ada985e for backstage 1.54.6 on branch main Sep 14, 2026
@github-actions

Copy link
Copy Markdown
Contributor Author

Update Commit workflow has completed with success.

@sonarqubecloud

Copy link
Copy Markdown

@github-actions

Copy link
Copy Markdown
Contributor Author

Publish workflow has completed with success.

Publishing process

✅ Finished successfully.

✅ Published container images:

  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import:pr_3077__9.0.1
  • ghcr.io/redhat-developer/rhdh-plugin-export-overlays/red-hat-developer-hub-backstage-plugin-bulk-import-backend:pr_3077__9.0.1

Backstage Compatibility Check

✅ All workspaces are compatible with the target Backstage version (1.54.6).

No action required.

Metadata Validation

✅ All metadata files validated successfully.

Running e2e tests
/test e2e-ocp-helm

@github-actions

Copy link
Copy Markdown
Contributor Author

❌
Smoke tests workflow failed.

⚠️ Smoke tests failed. Check the workflow logs for details.

Error logs from container
#  node[1]: void node::RemoveEnvironmentCleanupHook(v8::Isolate*, CleanupHook, void*) at ../../src/api/hooks.cc:142
  #  Assertion failed: (env) != nullptr

----- Native stack trace -----

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests (-w bulk-import)

Platform: ocp 4.20 | RHDH Version: 1.11 | Duration: 8m 19s
Passed: 1 | Failed: 5 | Flaky: 0 | Skipped: 16
Playwright Report | Build Log | Logs | Artifacts

@PatAKnight

Copy link
Copy Markdown
Member

/smoketest next-10310a5a

@github-actions

Copy link
Copy Markdown
Contributor Author

❌
Smoke tests workflow failed.

⚠️ Smoke tests failed. Check the workflow logs for details.

Error logs from container
'rhdh' container was not available. Check earlier steps for startup errors.

@rhdh-gh-app rhdh-gh-app Bot added ci-diagnose Triggers the fullsend ci-diagnose agent and removed ci-diagnose Triggers the fullsend ci-diagnose agent labels Sep 14, 2026
@fullsend-ai-review

fullsend-ai-review Bot commented Sep 14, 2026 •

Copy link
Copy Markdown

🤖 Finished Ci Diagnose · ✅ Success · Started 9:39 PM UTC · Completed 10:11 PM UTC

Commit: 7272f4f · View workflow run →

Runtime: claude · Model: opus → claude-opus-4-6 · Cost: $7.23

@fullsend-ai-review

fullsend-ai-review Bot commented Sep 14, 2026 •

Copy link
Copy Markdown

🔍 CI Diagnosis — 3 of 5 curated checks failing · 7272f4f

Verdict: None of the 3 failures are caused by this PR. Both Prow e2e checks fail due to a pre-existing auth config mismatch in the bulk-import workspace (already being fixed in #3756). The smoketest failed because the RHDH image tag it was given has expired from the registry.

❌ ci/prow/e2e-ocp-helm — pre_existing

Root cause: The bulk-import workspace’s app-config-rhdh.yaml sets auth.environment: development and defines auth.providers.github.development without signIn.resolvers. The e2e-test-utils framework injects its default GitHub auth at auth.providers.github.production with proper signIn.resolvers. During deep merge, the workspace’s config overwrites the environment to development, which lacks resolvers — breaking GitHub OAuth login for all tests calling loginAsGithubUser(). The single passing test uses loginAsGuest(), confirming this is the broken path.

Evidence: 1 pass / 4 fail / 16 skip consistently across runs. PR #3077 modifies only metadata, source.json, and versions.json — zero test code changes.

Open PRs:

Suggested fix: Merge #3756 first, then re-run. No changes to this PR are needed.

logs

❌ ci/prow/e2e-ocp-helm-nightly-pr-scoped — pre_existing

Root cause: Same auth config mismatch as e2e-ocp-helm. The bulk-import app-config-rhdh.yaml overrides auth.environment to development without signIn.resolvers, breaking GitHub OAuth login. In nightly mode, plugin OCI refs are rewritten to the productized registry image (not GHCR metadata refs), so the PR’s metadata version bumps are not used — ruling out this PR’s changes as a cause. The nightly check actually performed slightly better (2 pass vs 1 pass).

Evidence: 2 pass / 4 fail / 16 skip. All failures trace through signInForBulkImportTests() → loginAsGithubUser(). Zero test code changes in this PR.

Open PRs:

Suggested fix: Merge #3756 first, then re-run. No changes to this PR are needed.

logs

❌ smoketest — config_env

Root cause: The smoketest was triggered with RHDH image tag next-10310a5a, but this tag has expired or been garbage-collected from Quay.io’s registry. The docker run command failed immediately with exit code 125 — the container never started.

Evidence:

docker: Error response from daemon: unknown: Tag next-10310a5a was deleted or has expired.
To pull, revive via time machine

logs


Automated CI diagnosis · updates as checks complete · not a substitute for review. For bot-authored PRs, pr_regression failures are handed to the fix agent automatically (up to 2 attempts). pre_existing failures are linked to an open PR when one already exists. A maintainer can take over any time with /fs-fix <instruction>, or stop auto-fix with /fs-fix-stop — see the fix agent docs.

@subhashkhileri

Copy link
Copy Markdown
Member

/test e2e-ocp-helm-nightly-pr-scoped

@rhdh-test-bot

Copy link
Copy Markdown

❌ Failed E2E Tests (-w bulk-import)

Platform: ocp 4.20 | RHDH Version: 1.11 | Duration: 8m 49s
Passed: 2 | Failed: 4 | Flaky: 0 | Skipped: 16
Playwright Report | Build Log | Logs | Artifacts

@openshift-ci

openshift-ci Bot commented Sep 15, 2026

Copy link
Copy Markdown

@github-actions[bot]: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-ocp-helm 7272f4f link false /test e2e-ocp-helm
ci/prow/e2e-ocp-helm-nightly-pr-scoped 7272f4f link false /test e2e-ocp-helm-nightly-pr-scoped

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@rhdh-gh-app rhdh-gh-app Bot added ci-diagnose Triggers the fullsend ci-diagnose agent and removed ci-diagnose Triggers the fullsend ci-diagnose agent labels Sep 15, 2026
@fullsend-ai-review

fullsend-ai-review Bot commented Sep 15, 2026 •

Copy link
Copy Markdown

🤖 Finished Ci Diagnose · ✅ Success · Started 7:10 AM UTC · Completed 7:21 AM UTC

Commit: 7272f4f · View workflow run →

Runtime: claude · Model: opus → claude-opus-4-6 · Cost: $3.24

@lholmquist

Copy link
Copy Markdown
Member

This PR, #2661 (comment) , includes a fix for some of the orchestrator related test failures, and as of yesterday it looks like all the tests passed except the smoke tests

@lholmquist lholmquist closed this Sep 15, 2026
@lholmquist
lholmquist deleted the workspaces/main__bulk-import branch September 15, 2026 12:41
@lholmquist

Copy link
Copy Markdown
Member

Merged in #2661, waiting for this to get recreated

@fullsend-ai-retro

fullsend-ai-retro Bot commented Sep 15, 2026 •

Copy link
Copy Markdown

🤖 Finished Retro · ✅ Success · Started 12:42 PM UTC · Completed 1:00 PM UTC

Commit: 7272f4f · View workflow run →

Runtime: claude · Model: opus → claude-opus-4-6 · Effort: high · Cost: $4.24

@lholmquist

Copy link
Copy Markdown
Member

new PR #3798

@fullsend-ai-retro

Copy link
Copy Markdown

Retro: PR #3077 — Automated bulk-import workspace update (45 days open, closed without merge)

Timeline

PR #3077 was a bot-authored workspace-update PR created Aug 1 to update the bulk-import workspace (Backstage 1.52.0→1.54.6, plugins 8.0.0→9.0.1). Over 45 days, 6 E2E test runs were manually triggered by 5 different humans — all failing with the same pre-existing auth config mismatch (auth.environment: development without signIn.resolvers). CI diagnose only ran on day 44, correctly diagnosing all failures as pre-existing. The PR was closed on Sep 15 when PR #2661 (a human-authored PR covering the same workspace update plus test fixes) was merged.

What went well

  • CI diagnose agent performed excellently — correctly identified all 3 failing checks as not caused by this PR, pointed to the right fix (PR #3756), and classified the smoke test failure as an expired image tag. Cost: $7.23 (first run) + $3.24 (second run).
  • Publishing workflow worked reliably across all runs.
  • Version mismatch detection correctly blocked publishing when versions.json was stale.

Key gap (now resolved)

The CI diagnose bootstrap workflow (.github/workflows/ci-diagnose-agent.yaml) — which auto-triggers CI diagnose on check failures — was introduced by PR #2661, merged the same day #3077 was closed. Before the bootstrap existed, CI diagnose could only be triggered manually via /fs-diagnose or by adding the ci-diagnose label. This explains the 44-day delay: no one knew to trigger it manually, so 5 humans spent time retrying tests that were predetermined to fail.

Evidence supporting existing open issues

  • #3690 (suppress CI diagnose re-fire after same verdict): CI diagnose ran twice on the same commit 7272f4f with identical "not PR's fault" verdict, costing $3.24 on the redundant second run.
  • #3767 (auto-run /update-versions on mismatch): versions.json went stale twice, blocking publishing and requiring manual /update-versions on Aug 5 (failed) and Sep 9 (succeeded), plus manual /update-commit on Sep 14.
  • #2939 (detect major version bumps and add warning labels): Plugins bumped 8.0.0→9.0.1 (major) and CLI bumped 1.11.4→2.0.3 (major) with no warning, label, or review agent dispatch despite AGENTS.md guidance on major version bump review.
  • #2815 (auto-close stale workspace-update PRs): PR went stale after 39 days of inactivity before a human revived it on Sep 9.

Proposals filed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-diagnose Triggers the fullsend ci-diagnose agent mandatory-workspace PR affects a workspace with required plugins for releases ok-to-test stale workspace-update PR modifies files in an existing workspace

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants