Evaluation icons

The 13 evaluation icons, described

Benchmark suitebenchmark-suite

A clipboard with bars on it — the set of tests a model's score comes from.

Consistency checkconsistency-check

A speech bubble with an equals sign — the same question asked twice, answered the same.

Error analysiserror-analysis

A clipboard with a lens on it — the wrong answers, looked at one by one.

Eval costeval-cost

A receipt with a coin on it — what an evaluation run costs to make.

Eval dataseteval-dataset

A folder with bars in it — the examples a score is measured on.

Eval reporteval-report

A clipboard with a line and a check under it — the results, written up.

Eval sliceeval-slice

A clipboard with brackets on it — one part of the eval, looked at on its own.

Eval traceeval-trace

A receipt with a check on it — the log of a run, with its verdict.

Factuality testfactuality-test

The flask with a check in it — the model's claims put to the test.

Gold setgold-set

A coin landing in a tray — the examples whose answers are known to be right.

Judge modeljudge-model

A scale come down on one side — a model that weighs two answers and picks one.

Retrieval evaluationretrieval-eval

The lens with a check and a cross in it — the hits and the misses, counted.

Slice analysisslice-analysis

Axes split by a line with a point each side — the score, broken down by group.

In code, each is one import — import { BenchmarkSuite } from "@iconmind/react/icons/benchmark-suite" — and the same name in Vue, Svelte, Solid, Preact, React Native, Astro, Blade and Flutter.

Tags these icons also carry