estimators#

Estimators calculate performance bounds and the statistical distance between datasets.

Metric Functions#

ber(images, labels[, k, method])

An estimator for Multi-class Bayes Error Rate using FR or KNN test statistic basis

divergence(data_a, data_b[, method])

Calculates the divergence and any errors between the datasets

uap(labels, scores)

FR Test Statistic based estimate of the empirical mean precision for the upperbound average precision

Output Classes#

BEROutput(ber, ber_lower)

Output class for ber() estimator metric

DivergenceOutput(divergence, errors)

Output class for divergence() estimator metric

UAPOutput(uap)

Output class for uap() estimator metric