Analytics

odelmetry generates a lot of data to help you understand how your LLM-powered features behave, perform, and evolve over time. It is therefore important for our team to help you get insights and helpful data visualisations in a simple and effective manner.

Dashboards

Each team has a shared dashboard; so the entire team sees the same data at any time. A dashboard is essentially a grid-layout with the ability for allowed members to add data visualisation widgets of various types.

A dashboard shows data that spans across a pre-defined period: 24h, 3 days, 7 days, 14 days, 30 days, 60 days, or 90 days. This setting can be adjusted via the Period dropdown in the header.

We heard your feedback and are working on having team dashboards as well as member-specific private dashboards with easy switch between all. We are looking for more feedback on this so we can make sure we work on and deliver the best experience for our users. Please contact us at modelmetry.com/contact!

Widgets

A Widget is a self-contained data visualisation card that is placed on a dashboard view. There are different types of widgets which offer different options.

A widget can be added to a dashboard via the Add widget button in the header.

Metric Timeseries

A time series chart for a specific numerical finding (i.e., a metric).

Attribute	Description
Finding	The metric you want to chart.
Aggregator	The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.
Granularity	The level of detail for the time interval in the time series. It is one of month, day, hour, minute. Please note, the available options also depend on the period used to query the data (e.g., a 90d period only allows month and day).

A chart of the average of modelmetry.text-readability.v1/fkgl across a given period.

A chart of the sum of modelmetry.text-readability.v1/wordcount across a given period.

Metric Indicator

A single figure for a specific numerical finding (i.e., a metric). This is particularly useful when you want to have a higher-level view of a particular metric that you really care about.

Attribute	Description
Finding	The metric you want to chart.
Aggregator	The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.

Multiple metric indicators laid out on a dashboard view.

Guardrail Outcome Breakdown

A pie chart breaking down the outcomes of all guardrail checks across the given time period.