Analytics
odelmetry generates a lot of data to help you understand how your LLM-powered features behave, perform, and evolve over time. It is therefore important for our team to help you get insights and helpful data visualisations in a simple and effective manner.
Dashboards
Each team has a shared dashboard; so the entire team sees the same data at any time. A dashboard is essentially a grid-layout with the ability for allowed members to add data visualisation widgets of various types.
A dashboard shows data that spans across a pre-defined period: 24h, 3 days, 7 days, 14 days, 30 days, 60 days, or 90 days. This setting can be adjusted via the Period dropdown in the header.
Widgets
A Widget is a self-contained data visualisation card that is placed on a dashboard view. There are different types of widgets which offer different options.
A widget can be added to a dashboard via the Add widget button in the header.
Metric Timeseries
A time series chart for a specific numerical finding (i.e., a metric).
Finding
The metric you want to chart.
Aggregator
The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.
Granularity
The level of detail for the time interval in the time series. It is one of month, day, hour, minute. Please note, the available options also depend on the period used to query the data (e.g., a 90d period only allows month and day).
modelmetry.text-readability.v1/fkgl across a given period.
Metric Indicator
A single figure for a specific numerical finding (i.e., a metric). This is particularly useful when you want to have a higher-level view of a particular metric that you really care about.
Finding
The metric you want to chart.
Aggregator
The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.
Guardrail Outcome Breakdown
A pie chart breaking down the outcomes of all guardrail checks across the given time period.
Last updated