[ci-analyser-agent] fix: revert HyperShift operator to stable image#613
Conversation
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Enterprise Run ID: 📒 Files selected for processing (1)
✅ Files skipped from review due to trivial changes (1)
📝 WalkthroughWalkthroughThe hypershift operator image in ChangesHypershift Operator Image Pin
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~2 minutes 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Hi @rosa-regional-platform-ci. Thanks for your PR. I'm waiting for a openshift-online member to verify that this patch is reasonable to test. If it is, they should reply with Tip We noticed you've done this a few times! Consider joining the org to skip this step and gain Once the patch is verified, the new status will be reflected by the I understand the commands that are listed here. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
|
/ok-to-test |
|
Updated diagnosis based on latest failures (2026-06-16): Nightly Ephemeral: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-online-rosa-regional-platform-main-nightly-ephemeral/2066732986778259456 New diagnosis: Both jobs fail with the same root cause as yesterday. The HCP cluster enters The custom HyperShift operator image ( Changes: No new code changes needed — the fix in this PR (reverting the HyperShift operator image to a stable SHA) addresses both failures. This PR needs to be merged to unblock both nightly jobs. |
|
Updated based on latest failure: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-online-rosa-regional-platform-main-nightly-ephemeral/2067457823523999744 New diagnosis: Same root cause — the custom HyperShift operator image Today's failure evidence (2026-06-18):
Changes: No new changes needed — this PR's revert to the stable HyperShift image is still the correct fix. Needs merge to stop recurring failures. |
|
Updated fix based on latest failure: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-online-rosa-regional-platform-main-nightly-ephemeral/2068544912382496768 New diagnosis: Same root cause — the custom HyperShift image Changes: No code changes needed — this PR already contains the correct fix (revert to Note: PR #626 (disable FIPS endpoints) addresses the separate provision failure seen on 2026-06-20 and is unrelated to this HyperShift issue. |
The custom aws-iam-auth POC build (quay.io/cbusse_openshift/hypershift-operator:aws-iam-auth) introduced in cd811ae causes HostedClusterDegraded within 3 seconds of cluster creation in the nightly-ephemeral CI job. E2E test clusters do not carry the aws-iam-authenticator config required by the POC operator, triggering an immediate failure. Revert to the last known-good HyperShift operator image until the aws-iam-auth POC is stable and tested against CI workloads. Job: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-online-rosa-regional-platform-main-nightly-ephemeral
3bf7def to
7e48b53
Compare
|
Updated fix based on latest failure: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-online-rosa-regional-platform-main-nightly-ephemeral/2068907377599451136 New diagnosis: Same root cause — still failing as of 2026-06-22. The broken HyperShift POC image ( This has now failed on 2026-06-18, 2026-06-21, and 2026-06-22. The fix branch has been rebased onto latest Changes: Branch rebased onto current |
|
Closing, the clusters become ready so this is not part of the root cause. |
Root cause
The
nightly-ephemeraljob fails because the HCP cluster created by the e2e tests (e2e-1781498628) entersHostedClusterDegradedwithin 3 seconds of creation.Evidence
From the Prow build log (
rosa-regional-platform-e2e/step,build-log.txt):Root cause analysis
Commit
cd811ae7(2026-06-11) replaced the HyperShift operator with a custom POC build:The POC build adds aws-iam-authenticator injection and an
aws-iam-auth-configConfigMap sync controller. E2e test clusters do not carry thehypershift.openshift.io/aws-iam-authenticatorannotation or the corresponding ConfigMap, so the custom controller setsHostedClusterDegradedimmediately.Fix
Revert
argocd/config/management-cluster/hypershift/values.yamlto the last known-good HyperShift operator image. The aws-iam-auth POC changes in the ManifestWork (manifestwork.yaml) are left in place and can be re-enabled once the operator is validated against CI workloads.Failing job
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-online-rosa-regional-platform-main-nightly-ephemeral
Changes
argocd/config/management-cluster/hypershift/values.yaml: revert HyperShift operator image to stable SHA🤖 Opened automatically by the CI Analyser agent
Summary by CodeRabbit