Skip to content

[weave] Alerts on monitors page DOCS-1938#2261

Merged
anastasiaguspan merged 13 commits intomainfrom
alert-on-monitors-docs-1938
Apr 3, 2026
Merged

[weave] Alerts on monitors page DOCS-1938#2261
anastasiaguspan merged 13 commits intomainfrom
alert-on-monitors-docs-1938

Conversation

@anastasiaguspan
Copy link
Copy Markdown
Contributor

@anastasiaguspan anastasiaguspan commented Mar 10, 2026

Description

New automations feature being released for Weave. (new side nav feature with new docs page to discuss it)

Testing

  • [ x] Local build succeeds without errors (mint dev)
  • [x ] Local link check succeeds without errors (mint broken-links)
  • PR tests succeed

Related issues

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 10, 2026

📚 Mintlify Preview Links

🔗 View Full Preview

✨ Added (1 total)

📄 Pages (1)

File Preview
weave/guides/evaluation/automations.mdx Automations

📝 Changed (1 total)

⚙️ Other (1)
File
docs.json

🤖 Generated automatically when Mintlify deployment succeeds
📍 Deployment: fd79873 at 2026-04-02 20:56:08 UTC

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 10, 2026

🔗 Link Checker Results

All links are valid!

No broken links were detected.

Checked against: https://wb-21fd5541-alert-on-monitors-docs-1938.mintlify.app

Copy link
Copy Markdown
Contributor

@NiWaRe NiWaRe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very comprehensive and clear from my side!

There are some minor considerations like the aggregation performance of scores (if the aggregation horizon for scores gets too long then performance will lack), alerting on feedback, scores, cost, latency but this will change over time anyways.

Copy link
Copy Markdown
Contributor

@mdlinville mdlinville left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

First pass review. A couple nits and a structural question / suggestion. I think we may be able to single-source some content, but the Weave flow doesn't seem 1:1 with the Models project flow, so maybe we need to handle it a bit differently than just linking out to the Models top-level pages. Also the Models content is undergoing a major revamp that you may be able to glean some benefit from, in #2249 . It seems like your doc may land first, so I could adapt that to what you end up with.


## Create an automation

Create an automation in three steps: configure the triggering event, select the action to perform, and review a summary before saving.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it necessary to separate the review step? I wonder if we can converge on a way to explain it. I've been working on an automation doc revamp and here is what I came up with. Interested in your thoughts. The Mermaid diagrams are externalized to snippets.

Copy link
Copy Markdown
Contributor Author

@anastasiaguspan anastasiaguspan Apr 2, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

by "separate the review step" I assume you mean the third step I mention? since it is a 3 part modal, and the 3rd pane of the modal (sorry, drawer ;) ) is to review, i think it would be more confusing not to separate it.
As for the link, there are a lot of pages in that PR you link - could you be more specific to what part your comparing ? thx

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think the reader is going to hold you to it in this summary / mental map builder. I would consider the confirmation to be the last substep of step 2.


The new automation appears in the Automations table on the Automations page.

## Create an automation from a monitor
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the section I meant for step 3 from above.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

step 3 i didn't really feel fit(/didn't follow) since it was in a section titled Prerequisites for creating an automation - kinda cyclic/recursive. (e.g citing the thing as step 3 in prereqs for the thing the prereq is a prereq of)

maybe i need to clarify this, but 'creating an automation from a monitor' is just a minor subset of steps from 'creating a automation' (e.g. it is a shortcut of one selection box). its an alternative method. It's frankly not very useful, but mentioned for completeness.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Before you can create the automation in Weave, you need a) a monitor, and b) either a webhook or a Slack integration configured in your team. That's what I mean. Maybe we are on the same page after Slack conversation.

anastasiaguspan and others added 2 commits April 2, 2026 13:52
Co-authored-by: Matt Linville <matt.linville@wandb.com>
Co-authored-by: Matt Linville <matt.linville@wandb.com>
@@ -19,12 +19,10 @@ Create an automation in three steps: configure the triggering event, select the

### Prerequisites

Automations can be sourced from either Ops or Monitors. If you want to alert on a monitor, your [monitor](/weave/guides/evaluation/monitors) should be created prior to creating the automation.
The triggering event (such as an Op or a monitor) and the action (such as a Slack integration) should exist prior to creating the automation that connects them.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is kind of passive (should exist) and kind of redefines what the word prerequisite means.

Copy link
Copy Markdown
Contributor

@mdlinville mdlinville left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks really good. I'll go ahead and approve so I don't block you. I can tag you when I am working on integrating this content into my WIP.

@anastasiaguspan anastasiaguspan merged commit 8617fac into main Apr 3, 2026
7 checks passed
@anastasiaguspan anastasiaguspan deleted the alert-on-monitors-docs-1938 branch April 3, 2026 12:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants