Skip to content

Guardrails DB: Enhance data points #123

Closed

Description

@pritam-T4D

Is your feature request related to a problem?
The current Guardrails DB lacks sufficient data points for effective RCA/debugging and performance tracking, which hinders our ability to analyze and improve system performance.

Describe the solution you'd like
Add more data points to the Guardrails DB, including:

  • Triggered validator config for each request
  • LLM critic response (e.g., score)
  • Provider response ID
  • Usage/stats data (cost, latency, tokens) for each request
Original issue

Need more data stored in the Guardrails DB (at request log table or validator log table) that can help us with RCA/Debugging and for tracking performance metrics.

  1. Which validaor config was triggered against request
  2. LLM critic response e.g Score
  3. provider response id
  4. More info that can help us to know cost, latency, tokens against a request (usage/stats data)

Activity

  1. changed the title [-]Additional data points needed in the DB[/-] [+]Guardrails DB: Enhance data points[/+] on May 25, 2026
  2. pritam-T4D commented on May 25, 2026

    @pritam-T4D
    Author
  3. PritamSGB commented on May 29, 2026

    @PritamSGB
    Collaborator

    Also as part of PII , if presidio returns the score , then requesting to store score also. I think you can store all such validator specific data in metadata column in json etc format. We can consume it from there. All these scores will be imp for debugging and also knowing the analytics around where most queries are falling (direct outlier or on boundry etc)

  4. self-assigned this
    on Aug 31, 2026
  5. moved this from To Do to In Progress in Kaapi-devon Aug 31, 2026
  6. moved this from In Progress to In Review in Kaapi-devon Sep 7, 2026
  7. moved this from In Review to Closed in Kaapi-devon Sep 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

  • Status
    Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions