Modelmetry Documentation
Back to site
  • Documentation
  • Getting Started
    • Concepts
  • Platform
    • Evaluators
    • Automations
    • Analytics
    • API Keys
    • Secrets
    • Team
      • Memberships
      • Invitations
      • Roles & Permissions
  • Evaluators
    • List of Evaluators
    • Prompt Shields (Azure)
    • DLP PII Detector (Google)
    • Text Moderation (Google)
    • Boolean LLM-as-Judge (Modelmetry)
    • Competitor Blocklist (Modelmetry)
    • Emotion Analysis (Modelmetry)
    • HTTP Request (Modelmetry)
    • Language Detector (Modelmetry)
    • Score LLM-as-Judge (Modelmetry)
    • Word Counter (Modelmetry)
  • Developers
    • Modelmetry JS SDK
    • Modelmetry Python SDK
Powered by GitBook
On this page
  • Dashboards
  • Widgets
  1. Platform

Analytics

PreviousAutomationsNextAPI Keys

Last updated 5 months ago

odelmetry generates a lot of data to help you understand how your LLM-powered features behave, perform, and evolve over time. It is therefore important for our team to help you get insights and helpful data visualisations in a simple and effective manner.

Dashboards

Each team has a shared dashboard; so the entire team sees the same data at any time. A dashboard is essentially a grid-layout with the ability for allowed members to add data visualisation widgets of various types.

A dashboard shows data that spans across a pre-defined period: 24h, 3 days, 7 days, 14 days, 30 days, 60 days, or 90 days. This setting can be adjusted via the Period dropdown in the header.

Widgets

A Widget is a self-contained data visualisation card that is placed on a dashboard view. There are different types of widgets which offer different options.

A widget can be added to a dashboard via the Add widget button in the header.

Metric Timeseries

A time series chart for a specific numerical finding (i.e., a metric).

Attribute
Description

Finding

The metric you want to chart.

Aggregator

The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.

Granularity

The level of detail for the time interval in the time series. It is one of month, day, hour, minute. Please note, the available options also depend on the period used to query the data (e.g., a 90d period only allows month and day).

Metric Indicator

A single figure for a specific numerical finding (i.e., a metric). This is particularly useful when you want to have a higher-level view of a particular metric that you really care about.

Attribute
Description

Finding

The metric you want to chart.

Aggregator

The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.

Guardrail Outcome Breakdown

A pie chart breaking down the outcomes of all guardrail checks across the given time period.

We heard your feedback and are working on having team dashboards as well as member-specific private dashboards with easy switch between all. We are looking for more feedback on this so we can make sure we work on and deliver the best experience for our users. Please contact us at !

modelmetry.com/contact
A chart of the average of modelmetry.text-readability.v1/fkgl across a given period.
A chart of the sum of modelmetry.text-readability.v1/wordcount across a given period.
Multiple metric indicators laid out on a dashboard view.