dataeval¶

DataEval provides a simple interface to characterize image data and its impact on model performance.

It works across classification and object-detection tasks. It also provides capabilities to select and curate datasets to test and train performant, robust, unbiased and reliable AI models and monitor for data shifts that impact performance of deployed models.

Submodules¶

`bias`	Check for skewed or imbalanced datasets and incomplete feature representation.
`config`	Global configuration settings for DataEval.
`core`	Core stateless functions for performing dataset, metadata and model evaluation.
`extractors`	Feature extractors that transform input data into arrays.
`flags`	Module for flag enums that control function behavior.
`performance`	Determine whether a problem is feasible and how much data is needed.
`protocols`	Common type protocols used for interoperability with DataEval.
`quality`	Identify potential issues in training and test data.
`selection`	Provides selection classes for selecting subsets of Computer Vision datasets.
`shift`	Detect changes in data between different datasets.
`types`	Data types used in DataEval.
`utils`	DataEval utilities organized by domain.

Classes¶

`Embeddings`	Collection of image embeddings from a dataset.
`Metadata`	Collection of binned metadata using Polars DataFrames.

Functions¶

`log`([level, handler])	Add a StreamHandler to the logger quickly for debugging.