Skip to content

Add alert for repeated /api/scan/v0/sv-bft-sequencers fails - #6675

Merged
martinflorian-da merged 1 commit into
mainfrom
martinflorian-da/scan-bft-sequencers-read-alert
Aug 5, 2026
Merged

Add alert for repeated /api/scan/v0/sv-bft-sequencers fails#6675
martinflorian-da merged 1 commit into
mainfrom
martinflorian-da/scan-bft-sequencers-read-alert

Conversation

@martinflorian-da

@martinflorian-da martinflorian-da commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Part of https://github.com/DACH-NY/cn-test-failures/issues/9485 ; next step will be to demote the log to info (or at least avoid it being warn already on the first fail).

It seemed excessive to add parametrization for this alert. I suggest we only make it configurable if there is evidence we'll want to tweak it.

Pull Request Checklist

Cluster Testing

  • If a cluster test is required, comment /cluster_test on this PR to request it, and ping someone with access to the DA-internal system to approve it.
  • If an upgrade test is required, comment /upgrade_test on this PR to request it, and ping someone with access to the DA-internal system to approve it.
  • If a hard-migration test is required (from the latest release), comment /hdm_test on this PR to request it, and ping someone with access to the DA-internal system to approve it.
  • If a logical synchronizer upgrade test is required (from canton-3.5), comment /lsu_test on this PR to request it, and ping someone with access to the DA-internal system to approve it.

PR Guidelines

  • Include any change that might be observable by our partners or affect their deployment in the release notes.
  • Specify fixed issues with Fixes #n, and mention issues worked on using #n
  • Include a screenshot for frontend-related PRs - see README or use your favorite screenshot tool

Merge Guidelines

  • Make the git commit message look sensible when squash-merging on GitHub (most likely: just copy your PR description).

Part of DACH-NY/cn-test-failures#9485 ; next step will be to demote the log omitted there to info (or at least avoid it being warn already on the first fail).

[static]

Signed-off-by: Martin Florian <martin.florian@digitalasset.com>
@martinflorian-da martinflorian-da changed the title Add alert on SV BFT sequencer list reads failing on a scan [static] Add alert for repeated /api/scan/v0/sv-bft-sequencers fails Aug 5, 2026
@canton-network-da

Copy link
Copy Markdown
Contributor

[backport] Reminder

Please consider backporting to the following branches:

  • release-line-0.7.0
  • release-line-0.6.14
  • release-line-0.6.13
  • release-line-0.6.12

▶️ Please check the boxes for branches that you wish to backport to and backport PRs will
automatically be created when you merge this PR.

And your PR is currently against base branch: main.

Note: Any PR comment containing [backport] will be considered for auto-backporting upon merge,
you can always add those manually for PRs that did not get these reminders. You can also edit
this comment manually and add more branches that this should be backported to.

uid: prometheus
editorMode: code
expr: |-
sum by (namespace, job, target_host) (

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Query preview DevNet: Grafana link

@martinflorian-da
martinflorian-da marked this pull request as ready for review August 5, 2026 12:20

@moritzkiefer-da moritzkiefer-da left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice thanks

@martinflorian-da
martinflorian-da merged commit 496a0e4 into main Aug 5, 2026
48 checks passed
@martinflorian-da
martinflorian-da deleted the martinflorian-da/scan-bft-sequencers-read-alert branch August 5, 2026 12:58
martinflorian-da added a commit that referenced this pull request Aug 5, 2026
Fixes DACH-NY/cn-test-failures#9485

Alerting now covered via #6675

I contemplated making the logging smarter (only warn if stays failed for N minutes), but somehow I'm not convinced that this is worth the effort and added complexity.

Signed-off-by: Martin Florian <martin.florian@digitalasset.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants