Skip to content

Introduce consistent statistical metrics for histogram / distribution comparisions. #2192

@GernotMaier

Description

@GernotMaier

The long-integration tests introduce comparison between e.g. different production models. For continuous distributions, the KS statistics is used as metric.

Add statistical metrics for

  • categorical plots (e.g. trigger combinations); suggestions are Jensen-Shannon Divergence or simply a Root Mean Squared Error (distance between the two distributions)
  • ordered/numerical plot (e.g., trigger multiplicity): Wasserstein Distance

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions