dataeval.shift

Detect changes in data between different datasets.

Classes

DriftMMD

Drift detector using Maximum Mean Discrepancy (MMD) Drift Detection with permutation test.

DriftMVDC

Multivariant Domain Classifier

DriftUnivariate

Drift detector using univariate statistical tests.

EmbeddingsFeatureExtractor

Extract embeddings from datasets for drift detection.

LastSeenUpdateStrategy

Updates reference dataset for drift detector using last seen method.

MetadataFeatureExtractor

Extract metadata factors from datasets for drift detection.

OODKNeighbors

K-Nearest Neighbors Out-of-Distribution detector.

OODReconstruction

Autoencoder (AE) or Variational Autoencoder (VAE) based out-of-distribution detector.

OODReconstructionConfig

Configuration for OODReconstruction detector training and threshold computation.

ReservoirSamplingUpdateStrategy

Updates reference dataset for drift detector using reservoir sampling method.

UncertaintyFeatureExtractor

Feature extractor that converts data to model uncertainty scores.

Output Classes

DriftMMDOutput

Output class for DriftMMD (Maximum Mean Discrepancy) drift detector.

DriftMVDCOutput

Results of the multivariate domain classifier drift detection.

DriftOutput

Output class for univariate drift detectors.

OODOutput

Output class for predictions from out-of-distribution detectors.

OODScoreOutput

Output class for instance and feature scores from out-of-distribution detectors.