dataeval¶

DataEval provides a simple interface to characterize visual data and its impact on model performance.

It works across classification and object-detection tasks. It also provides capabilities to select and curate datasets to test and train performant, robust, unbiased and reliable AI models and monitor for data shifts that impact performance of deployed models.

Submodules¶

`bias`	Check for skewed or imbalanced datasets and incomplete feature representation.
`config`	Global configuration settings for DataEval.
`core`	Core stateless functions for performing dataset, metadata and model evaluation.
`exceptions`	Exception and warning classes for DataEval.
`extractors`	Feature extractors that transform input data into arrays.
`flags`	Module for flag enums that control function behavior.
`performance`	Determine whether a problem is feasible and how much data is needed.
`protocols`	Common type protocols used for interoperability with DataEval.
`quality`	Identify potential issues in training and test data.
`scope`	Evaluate data completeness and coverage in latent embedding space.
`selection`	Provides selection classes for selecting subsets of Computer Vision datasets.
`shift`	Detect changes in data between different datasets.
`types`	Data types used in DataEval.
`utils`	DataEval utilities organized by domain.

Classes¶

`Metadata`	Collection of binned metadata using Polars DataFrames.

Functions¶

`log`([level, handler])	Add a StreamHandler to the logger quickly for debugging.