Competitor Blocklist (Modelmetry)

This evaluator is designed to scan the input and output text for mentions of specified competitors and trigger a failure if the mentions exceed a set threshold. It supports adjusting sensitivity to case and defining where to look for mentions.

Configuration

Option	Description	Type	Default	Required	Constraints
LookIn	Where to search for competitor mentions	string	both	false	Enum: input, output, both
Competitors	List of competitors to search for	[]string		true	MinItems: 1
CaseSensitivity	Whether to consider the word's case when matching strings	string	case_sensitive	false	Enum: case_sensitive, case_insensitive
Threshold	The number of times a competitor must be mentioned to trigger a failure	int	1	false	-

Metrics

This evaluator reports the following metrics based on the analysis results:

Name	Key	Description	Min	Max
Competitor Mentions	competitor_mentions	How many times a competitor was mentioned	0	∞