dataeval.metrics.estimators#

Estimators calculate performance bounds and the statistical distance between datasets.

Classes#

BEROutput

Output class for ber() estimator metric

DivergenceOutput

Output class for divergence() estimator metric

UAPOutput

Output class for uap() estimator metric

Functions#

ber(images, labels[, k, method])

An estimator for Multi-class Bayes error rate using FR or KNN test statistic basis

divergence(data_a, data_b[, method])

Calculates the :term`divergence` and any errors between the datasets

uap(labels, scores)

FR Test Statistic based estimate of the empirical mean precision for