Analytics
Last updated
Last updated
odelmetry generates a lot of data to help you understand how your LLM-powered features behave, perform, and evolve over time. It is therefore important for our team to help you get insights and helpful data visualisations in a simple and effective manner.
Each team has a shared dashboard; so the entire team sees the same data at any time. A dashboard is essentially a grid-layout with the ability for allowed members to add data visualisation widgets of various types.
A dashboard shows data that spans across a pre-defined period: 24h, 3 days, 7 days, 14 days, 30 days, 60 days, or 90 days. This setting can be adjusted via the Period dropdown in the header.
A Widget is a self-contained data visualisation card that is placed on a dashboard view. There are different types of widgets which offer different options.
A widget can be added to a dashboard via the Add widget button in the header.
A time series chart for a specific numerical finding (i.e., a metric).
Finding
The metric you want to chart.
Aggregator
The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.
Granularity
The level of detail for the time interval in the time series. It is one of month, day, hour, minute. Please note, the available options also depend on the period used to query the data (e.g., a 90d period only allows month and day).
A single figure for a specific numerical finding (i.e., a metric). This is particularly useful when you want to have a higher-level view of a particular metric that you really care about.
Finding
The metric you want to chart.
Aggregator
The aggregation method to run over this metric. It is one of AVG, COUNT, SUM.
A pie chart breaking down the outcomes of all guardrail checks across the given time period.
We heard your feedback and are working on having team dashboards as well as member-specific private dashboards with easy switch between all. We are looking for more feedback on this so we can make sure we work on and deliver the best experience for our users. Please contact us at !
modelmetry.text-readability.v1/fkgl across a given period.
