dataeval¶

DataEval provides a simple interface to characterize image data and its impact on model performance across classification and object-detection tasks. It also provides capabilities to select and curate datasets to test and train performant, robust, unbiased and reliable AI models and monitor for data shifts that impact performance of deployed models.

Submodules¶

`bias`	Check for skewed or imbalanced datasets and incomplete feature representation which may impact model performance.
`config`	Global configuration settings for DataEval.
`core`	Core stateless functions for performing dataset, metadata and model evaluation.
`encoders`	Embedding encoders for extracting features from datasets.
`extractors`	Feature extractors for drift detection and quality metrics.
`flags`	Module for flag enums that control function behavior.
`performance`	Determine whether a problem is feasible and how much data is needed.
`protocols`	Common type protocols used for interoperability with DataEval.
`quality`	Identify potential issues in training and test data.
`selection`	Provides selection classes for selecting subsets of Computer Vision datasets.
`shift`	Detect changes in data between different datasets.
`types`	Data types used in DataEval.
`utils`	DataEval utilities organized by domain.

Classes¶

`Embeddings`	Collection of image embeddings from a dataset.
`Metadata`	Collection of binned metadata using Polars DataFrames.

Functions¶

`log`([level, handler])	Helper for quickly adding a StreamHandler to the logger. Useful for debugging.