Dataset Linting Tutorial#

Problem Statement#

Exploratory data analysis (EDA) can be overwhelming. There are so many things to check. Duplicates in your dataset, bad/corrupted images in the set, blurred or bright/dark images, the list goes on.

DataEval created a Linting class to assist you with your EDA so you can start training your models on high quality data.

When to use#

The Linting class should be used during the initial EDA process or if you are trying to verify that you have the right data in your dataset.

What you will need#

  1. A dataset to analyze

  2. A python environment with the following packages installed:

    • dataeval[torch] or dataeval[all]

    • torchvision

Getting Started#

Let’s import the required libraries needed to set up a minimal working example

import numpy as np
import torch
import torchvision.datasets as datasets
import torchvision.transforms.v2 as v2

from dataeval.detectors.linters import Outliers

Loading in the data#

We are going to start by loading in torchvision’s CIFAR-10 dataset.

The CIFAR-10 dataset contains 60,000 images - 50,000 in the train set and 10,000 in the test set. For the purposes of this demonstration, we are just going to use the test set.

# Load in the cifar-10 dataset from torchvision
to_tensor = v2.Compose([v2.ToImage(), v2.ToDtype(torch.float32, scale=True)])
testing_dataset = datasets.CIFAR10("./data", train=False, download=True, transform=to_tensor)
test_data = np.array(testing_dataset.data, dtype=float)
Files already downloaded and verified

Linting the Dataset#

Now we can begin finding those images which are significantly different from the rest of the data.

# Initialize the Duplicates class
outliers = Outliers()

# Evaluate the data
results = outliers.evaluate(test_data)

The results are a dictionary with the keys being the image that has an issue in one of the listed properties below:

  • Brightness

  • Blurriness

  • Missing

  • Zero

  • Width

  • Height

  • Size

  • Aspect Ratio

  • Channels

  • Depth

print(f"Total number of images with an issue: {len(results.issues)}")
Total number of images with an issue: 892
# Show each image that has at least one issue
for image, issue in results.issues.items():
    print(f"{image} - {issue}")
16 - {'zeros': 0.61}
21 - {'darkness': 0.94, 'zeros': 1.33}
41 - {'contrast': 4.81}
57 - {'contrast': 4.5, 'zeros': 6.69}
60 - {'blurriness': 95.75}
62 - {'contrast': 4.13, 'zeros': 0.53}
75 - {'blurriness': 112.38}
81 - {'contrast': 4.89, 'zeros': 3.29}
93 - {'blurriness': 93.06}
102 - {'contrast': 4.45, 'zeros': 1.45}
110 - {'blurriness': 91.88}
111 - {'zeros': 0.84}
112 - {'blurriness': 103.75}
118 - {'contrast': 6.38, 'zeros': 5.89}
123 - {'blurriness': 114.44}
162 - {'zeros': 1.0}
163 - {'blurriness': 91.44}
176 - {'blurriness': 107.44}
186 - {'contrast': 4.0}
190 - {'blurriness': 90.56}
197 - {'darkness': 0.77}
198 - {'zeros': 3.42}
212 - {'darkness': 0.76}
218 - {'darkness': 0.89}
244 - {'blurriness': 111.0}
249 - {'contrast': 5.47}
269 - {'darkness': 0.75}
273 - {'contrast': 4.64}
276 - {'zeros': 1.29}
277 - {'blurriness': 93.12}
286 - {'zeros': 1.23}
294 - {'zeros': 0.69}
313 - {'darkness': 0.83}
322 - {'contrast': 4.8, 'zeros': 0.7}
345 - {'zeros': 0.44}
347 - {'blurriness': 103.31}
374 - {'blurriness': 110.56}
382 - {'darkness': 0.91}
385 - {'darkness': 0.95}
387 - {'blurriness': 115.0}
391 - {'blurriness': 107.75}
392 - {'blurriness': 100.12}
414 - {'zeros': 0.44}
417 - {'zeros': 1.86}
420 - {'contrast': 4.68}
423 - {'contrast': 4.52}
455 - {'blurriness': 92.5}
456 - {'blurriness': 104.12}
499 - {'darkness': 0.82}
524 - {'darkness': 0.74}
535 - {'blurriness': 91.62}
557 - {'contrast': 4.02, 'zeros': 0.82}
564 - {'blurriness': 96.62}
565 - {'zeros': 0.58}
605 - {'zeros': 5.31}
611 - {'darkness': 0.78}
616 - {'zeros': 0.52}
649 - {'blurriness': 94.81}
653 - {'blurriness': 92.0}
659 - {'contrast': 3.84}
664 - {'contrast': 4.05}
671 - {'zeros': 1.17}
726 - {'contrast': 4.17}
731 - {'darkness': 0.78}
763 - {'zeros': 0.53}
765 - {'blurriness': 113.0}
782 - {'blurriness': 90.56}
802 - {'blurriness': 106.25}
807 - {'blurriness': 110.56}
813 - {'blurriness': 107.25}
834 - {'blurriness': 107.75}
872 - {'contrast': 7.59, 'zeros': 4.89}
888 - {'zeros': 3.01}
891 - {'blurriness': 114.12}
907 - {'contrast': 5.0}
911 - {'zeros': 0.48}
925 - {'contrast': 3.96, 'zeros': 11.01}
935 - {'darkness': 0.78}
943 - {'blurriness': 109.25}
947 - {'contrast': 4.2, 'zeros': 0.57}
991 - {'contrast': 4.73}
994 - {'zeros': 0.99}
1001 - {'contrast': 4.17}
1007 - {'zeros': 1.23}
1019 - {'blurriness': 100.88}
1022 - {'darkness': 0.76}
1034 - {'contrast': 3.86}
1039 - {'blurriness': 99.44}
1040 - {'zeros': 0.5}
1051 - {'blurriness': 103.19}
1052 - {'contrast': 4.38, 'zeros': 0.98}
1066 - {'contrast': 3.79}
1078 - {'darkness': 0.99}
1080 - {'zeros': 4.05}
1085 - {'blurriness': 100.69}
1086 - {'blurriness': 92.0}
1108 - {'zeros': 1.57}
1112 - {'contrast': 4.05}
1150 - {'zeros': 0.66}
1156 - {'contrast': 4.81, 'zeros': 3.92}
1164 - {'darkness': 0.82}
1178 - {'blurriness': 95.62}
1191 - {'contrast': 3.81}
1240 - {'contrast': 5.61, 'zeros': 0.57}
1249 - {'blurriness': 96.06}
1303 - {'blurriness': 119.81}
1307 - {'blurriness': 103.69, 'zeros': 0.89}
1319 - {'darkness': 0.93}
1327 - {'zeros': 0.82}
1351 - {'darkness': 0.76}
1388 - {'contrast': 4.34}
1416 - {'zeros': 0.56}
1418 - {'blurriness': 104.5}
1441 - {'blurriness': 92.38}
1451 - {'blurriness': 98.38}
1496 - {'blurriness': 111.69, 'zeros': 0.94}
1497 - {'zeros': 0.48}
1498 - {'blurriness': 101.62}
1510 - {'blurriness': 102.19}
1522 - {'blurriness': 106.56}
1541 - {'blurriness': 111.88}
1561 - {'zeros': 0.78}
1579 - {'blurriness': 103.31}
1595 - {'blurriness': 98.19}
1596 - {'contrast': 3.73}
1629 - {'darkness': 0.83}
1632 - {'zeros': 0.74}
1640 - {'zeros': 2.96}
1642 - {'blurriness': 98.44}
1646 - {'darkness': 0.84}
1651 - {'blurriness': 111.88}
1664 - {'darkness': 0.94}
1671 - {'zeros': 0.49}
1675 - {'contrast': 4.03}
1677 - {'contrast': 4.73}
1689 - {'zeros': 0.5}
1694 - {'darkness': 0.93}
1713 - {'zeros': 0.51}
1722 - {'zeros': 1.69}
1729 - {'zeros': 0.53}
1734 - {'zeros': 0.57}
1758 - {'blurriness': 105.12}
1762 - {'blurriness': 93.19}
1787 - {'darkness': 0.76}
1795 - {'contrast': 4.18}
1797 - {'zeros': 0.82}
1852 - {'zeros': 0.43}
1875 - {'blurriness': 92.38}
1878 - {'contrast': 3.75, 'zeros': 1.0}
1880 - {'contrast': 3.85, 'zeros': 1.51}
1892 - {'zeros': 0.5}
1899 - {'blurriness': 93.56}
1916 - {'contrast': 4.02}
1918 - {'blurriness': 104.38, 'zeros': 0.57}
1921 - {'zeros': 2.9}
1928 - {'blurriness': 96.88}
1942 - {'blurriness': 106.62}
1959 - {'zeros': 1.83}
1968 - {'blurriness': 105.19, 'zeros': 1.1}
1985 - {'blurriness': 106.12}
1988 - {'zeros': 0.95}
1996 - {'contrast': 4.28}
2010 - {'zeros': 9.6}
2041 - {'darkness': 0.74}
2067 - {'blurriness': 105.94}
2091 - {'contrast': 4.73}
2098 - {'contrast': 3.88}
2103 - {'blurriness': 102.06}
2119 - {'zeros': 0.82}
2122 - {'darkness': 0.75}
2128 - {'blurriness': 101.44}
2139 - {'zeros': 0.78}
2166 - {'blurriness': 115.06}
2175 - {'contrast': 3.86}
2199 - {'blurriness': 119.38}
2200 - {'blurriness': 99.69}
2201 - {'zeros': 0.61}
2210 - {'darkness': 0.75}
2214 - {'blurriness': 120.19}
2221 - {'blurriness': 114.31}
2247 - {'blurriness': 109.25}
2251 - {'darkness': 0.75}
2258 - {'blurriness': 94.38, 'contrast': 3.79}
2266 - {'zeros': 1.89}
2288 - {'blurriness': 110.81}
2309 - {'contrast': 4.19}
2313 - {'blurriness': 117.62}
2314 - {'darkness': 0.8}
2318 - {'blurriness': 96.81}
2323 - {'contrast': 4.16}
2325 - {'blurriness': 95.69}
2332 - {'darkness': 0.73}
2345 - {'blurriness': 104.94, 'zeros': 0.77}
2353 - {'blurriness': 96.25}
2373 - {'darkness': 0.91}
2377 - {'contrast': 3.81}
2381 - {'zeros': 4.89}
2390 - {'contrast': 4.93, 'zeros': 1.26}
2394 - {'blurriness': 120.19}
2400 - {'darkness': 0.97}
2405 - {'zeros': 0.44}
2435 - {'blurriness': 119.62}
2439 - {'blurriness': 96.06}
2443 - {'darkness': 0.76}
2448 - {'blurriness': 97.62}
2455 - {'contrast': 4.91}
2456 - {'darkness': 0.86}
2484 - {'zeros': 0.81}
2486 - {'blurriness': 98.12}
2494 - {'darkness': 0.79}
2499 - {'blurriness': 90.69, 'zeros': 0.44}
2537 - {'zeros': 0.46}
2582 - {'blurriness': 92.75}
2595 - {'blurriness': 97.25}
2608 - {'blurriness': 116.62}
2617 - {'zeros': 3.01}
2641 - {'blurriness': 103.12}
2663 - {'zeros': 0.89}
2691 - {'blurriness': 105.69}
2699 - {'blurriness': 103.44}
2708 - {'zeros': 0.44}
2729 - {'darkness': 0.89}
2734 - {'zeros': 0.46}
2740 - {'zeros': 1.5}
2746 - {'contrast': 4.5, 'zeros': 8.05}
2747 - {'zeros': 3.75}
2751 - {'blurriness': 92.88}
2752 - {'zeros': 3.76}
2754 - {'contrast': 9.02, 'zeros': 2.93}
2756 - {'blurriness': 110.44}
2757 - {'zeros': 0.74}
2763 - {'blurriness': 115.44}
2766 - {'blurriness': 115.12}
2772 - {'blurriness': 120.19, 'zeros': 0.95}
2792 - {'darkness': 0.75}
2797 - {'blurriness': 111.38}
2807 - {'zeros': 0.85}
2824 - {'blurriness': 105.31}
2834 - {'blurriness': 106.56}
2839 - {'blurriness': 101.19}
2840 - {'zeros': 15.43}
2841 - {'blurriness': 93.31}
2871 - {'darkness': 0.75}
2877 - {'zeros': 1.41}
2896 - {'zeros': 0.8}
2927 - {'blurriness': 102.81}
2940 - {'contrast': 4.69, 'zeros': 3.79}
2955 - {'contrast': 4.02}
2963 - {'zeros': 0.58}
2964 - {'blurriness': 104.0}
2967 - {'zeros': 1.91}
2968 - {'blurriness': 118.56}
2978 - {'zeros': 0.98}
2981 - {'contrast': 4.04}
2999 - {'blurriness': 104.81}
3039 - {'blurriness': 100.5}
3056 - {'blurriness': 92.0}
3058 - {'contrast': 4.06}
3098 - {'blurriness': 114.5}
3101 - {'zeros': 0.92}
3103 - {'blurriness': 110.19}
3113 - {'contrast': 3.93}
3119 - {'contrast': 8.0, 'zeros': 1.27}
3125 - {'zeros': 2.38}
3165 - {'blurriness': 92.12}
3169 - {'zeros': 0.76}
3170 - {'zeros': 0.53}
3171 - {'zeros': 2.1}
3178 - {'blurriness': 94.31}
3197 - {'blurriness': 105.19}
3201 - {'zeros': 1.0}
3206 - {'darkness': 0.77}
3209 - {'blurriness': 105.31}
3221 - {'blurriness': 112.81}
3227 - {'blurriness': 119.81}
3252 - {'blurriness': 110.44}
3263 - {'blurriness': 93.5}
3294 - {'darkness': 0.79}
3304 - {'blurriness': 93.19}
3310 - {'blurriness': 99.19}
3326 - {'blurriness': 96.19, 'contrast': 3.87}
3343 - {'zeros': 0.81}
3356 - {'contrast': 5.79}
3361 - {'zeros': 1.19}
3370 - {'zeros': 0.5}
3378 - {'blurriness': 117.12}
3379 - {'blurriness': 101.56}
3400 - {'contrast': 6.04}
3401 - {'blurriness': 105.25}
3408 - {'blurriness': 114.62}
3422 - {'zeros': 0.45}
3426 - {'darkness': 0.75}
3439 - {'contrast': 3.73}
3443 - {'blurriness': 98.88}
3444 - {'darkness': 1.0}
3472 - {'zeros': 0.47}
3480 - {'blurriness': 109.19}
3485 - {'zeros': 1.33}
3498 - {'zeros': 1.24}
3512 - {'blurriness': 104.06}
3522 - {'blurriness': 100.94}
3536 - {'darkness': 0.82}
3541 - {'blurriness': 95.62}
3551 - {'darkness': 0.89}
3561 - {'zeros': 0.78}
3576 - {'blurriness': 105.44}
3582 - {'contrast': 7.32, 'zeros': 15.32}
3591 - {'blurriness': 98.94}
3621 - {'darkness': 0.91}
3624 - {'blurriness': 103.81}
3629 - {'zeros': 0.6}
3633 - {'zeros': 0.68}
3650 - {'blurriness': 120.0}
3681 - {'blurriness': 109.88}
3713 - {'contrast': 4.42, 'zeros': 1.81}
3721 - {'blurriness': 90.62}
3724 - {'contrast': 6.36}
3725 - {'blurriness': 101.12}
3758 - {'contrast': 7.91, 'zeros': 1.99}
3759 - {'blurriness': 99.38}
3762 - {'contrast': 3.86}
3764 - {'darkness': 0.77}
3770 - {'zeros': 0.53}
3789 - {'blurriness': 93.0}
3797 - {'blurriness': 100.44}
3802 - {'zeros': 0.46}
3810 - {'blurriness': 103.44}
3816 - {'blurriness': 99.62}
3823 - {'darkness': 0.97}
3838 - {'contrast': 3.96}
3851 - {'blurriness': 109.44}
3863 - {'blurriness': 105.81}
3917 - {'blurriness': 91.0}
3953 - {'blurriness': 91.25}
3963 - {'zeros': 0.47}
3976 - {'zeros': 0.45}
3977 - {'blurriness': 97.5}
3986 - {'contrast': 4.09, 'zeros': 3.45}
3990 - {'blurriness': 110.88}
4001 - {'contrast': 4.02}
4009 - {'zeros': 1.15}
4013 - {'zeros': 1.85}
4015 - {'zeros': 0.53}
4032 - {'zeros': 0.97}
4035 - {'contrast': 4.36, 'zeros': 1.62}
4049 - {'blurriness': 112.44}
4052 - {'zeros': 0.82}
4055 - {'contrast': 3.96}
4059 - {'zeros': 1.12}
4060 - {'blurriness': 114.31}
4076 - {'zeros': 0.51}
4077 - {'blurriness': 93.56}
4123 - {'blurriness': 101.5}
4132 - {'blurriness': 98.44}
4147 - {'blurriness': 91.25}
4159 - {'blurriness': 110.81}
4164 - {'contrast': 4.28}
4193 - {'darkness': 0.79}
4204 - {'blurriness': 120.19}
4234 - {'blurriness': 96.75}
4235 - {'blurriness': 91.12}
4272 - {'blurriness': 109.25}
4273 - {'darkness': 0.81}
4285 - {'blurriness': 100.12}
4309 - {'blurriness': 108.38}
4325 - {'blurriness': 90.94}
4336 - {'zeros': 0.62}
4353 - {'blurriness': 119.88}
4355 - {'contrast': 6.3, 'zeros': 9.65}
4362 - {'blurriness': 94.5}
4364 - {'zeros': 0.74}
4373 - {'blurriness': 96.81}
4379 - {'zeros': 0.66}
4388 - {'darkness': 0.94}
4394 - {'zeros': 1.51}
4396 - {'zeros': 0.68}
4415 - {'darkness': 0.74}
4421 - {'zeros': 4.43}
4423 - {'contrast': 3.93, 'zeros': 2.32}
4425 - {'zeros': 0.6}
4426 - {'darkness': 0.78}
4427 - {'contrast': 5.74}
4429 - {'blurriness': 105.06}
4434 - {'darkness': 0.96}
4442 - {'blurriness': 107.75}
4446 - {'blurriness': 107.69}
4448 - {'blurriness': 96.94}
4452 - {'contrast': 4.03, 'zeros': 0.72}
4453 - {'blurriness': 105.44, 'zeros': 0.73}
4475 - {'darkness': 0.77}
4478 - {'contrast': 5.62}
4482 - {'blurriness': 93.69, 'zeros': 1.09}
4484 - {'blurriness': 117.44}
4504 - {'darkness': 0.78}
4505 - {'blurriness': 119.12}
4513 - {'zeros': 1.11}
4530 - {'darkness': 0.73}
4534 - {'blurriness': 111.88}
4546 - {'darkness': 0.91}
4550 - {'contrast': 9.16}
4552 - {'zeros': 0.64}
4558 - {'darkness': 0.78}
4564 - {'blurriness': 101.5}
4566 - {'darkness': 0.85}
4567 - {'blurriness': 103.75}
4580 - {'blurriness': 120.19}
4634 - {'zeros': 9.69}
4641 - {'blurriness': 99.25}
4668 - {'zeros': 2.23}
4669 - {'blurriness': 99.06}
4670 - {'contrast': 4.91}
4672 - {'blurriness': 104.06}
4683 - {'blurriness': 100.5}
4702 - {'contrast': 4.42, 'zeros': 0.92}
4711 - {'zeros': 0.44}
4753 - {'zeros': 3.83}
4756 - {'blurriness': 101.25}
4774 - {'blurriness': 113.62}
4790 - {'zeros': 1.17}
4802 - {'zeros': 0.77}
4814 - {'contrast': 5.01}
4839 - {'blurriness': 92.94}
4847 - {'blurriness': 92.0}
4858 - {'blurriness': 120.19}
4876 - {'darkness': 0.75}
4891 - {'zeros': 0.48}
4894 - {'blurriness': 119.12}
4902 - {'blurriness': 100.94}
4904 - {'zeros': 0.54}
4941 - {'contrast': 4.5}
4968 - {'darkness': 0.9}
4985 - {'blurriness': 108.19}
4989 - {'contrast': 4.78}
5008 - {'blurriness': 110.69}
5022 - {'blurriness': 119.31}
5023 - {'zeros': 1.83}
5026 - {'blurriness': 116.06}
5044 - {'blurriness': 100.56}
5071 - {'zeros': 0.7}
5084 - {'zeros': 4.76}
5088 - {'zeros': 0.7}
5090 - {'zeros': 0.71}
5102 - {'blurriness': 100.81}
5113 - {'contrast': 4.22}
5139 - {'zeros': 1.15}
5148 - {'zeros': 0.96}
5171 - {'zeros': 1.76}
5172 - {'blurriness': 98.06}
5195 - {'blurriness': 95.0}
5215 - {'zeros': 0.59}
5219 - {'blurriness': 117.75}
5229 - {'contrast': 3.86}
5244 - {'blurriness': 93.0}
5258 - {'zeros': 1.72}
5263 - {'zeros': 0.73}
5264 - {'blurriness': 92.44}
5270 - {'contrast': 4.34, 'zeros': 4.31}
5274 - {'blurriness': 93.88}
5284 - {'zeros': 7.5}
5289 - {'blurriness': 113.31}
5330 - {'contrast': 3.82}
5331 - {'blurriness': 119.0}
5362 - {'blurriness': 92.75}
5373 - {'contrast': 4.51}
5385 - {'contrast': 4.21}
5390 - {'contrast': 3.76}
5391 - {'zeros': 0.51}
5402 - {'blurriness': 104.31}
5403 - {'blurriness': 107.88}
5404 - {'blurriness': 111.0}
5423 - {'blurriness': 117.56}
5442 - {'blurriness': 103.19}
5456 - {'contrast': 4.64, 'zeros': 3.81}
5460 - {'contrast': 4.23, 'zeros': 10.62}
5465 - {'blurriness': 91.56}
5469 - {'contrast': 4.14}
5473 - {'zeros': 0.66}
5474 - {'contrast': 3.94}
5478 - {'zeros': 2.76}
5486 - {'contrast': 3.75}
5493 - {'contrast': 4.39}
5495 - {'zeros': 1.02}
5496 - {'blurriness': 98.75}
5520 - {'zeros': 0.95}
5526 - {'zeros': 0.49}
5537 - {'darkness': 0.82}
5539 - {'contrast': 5.26}
5551 - {'zeros': 0.53}
5563 - {'contrast': 4.68}
5570 - {'zeros': 10.96}
5583 - {'darkness': 0.9}
5584 - {'darkness': 0.92}
5591 - {'contrast': 4.21, 'zeros': 3.23}
5595 - {'blurriness': 116.31}
5613 - {'blurriness': 92.06}
5620 - {'blurriness': 120.19}
5642 - {'blurriness': 99.69}
5653 - {'zeros': 0.67}
5671 - {'contrast': 5.83}
5704 - {'blurriness': 91.31}
5708 - {'contrast': 4.12}
5712 - {'blurriness': 92.5}
5715 - {'contrast': 4.24}
5723 - {'blurriness': 95.31}
5727 - {'blurriness': 112.25, 'contrast': 3.97, 'zeros': 2.83}
5728 - {'blurriness': 94.69}
5740 - {'blurriness': 120.19}
5743 - {'zeros': 3.67}
5774 - {'blurriness': 104.81}
5777 - {'zeros': 0.47}
5792 - {'blurriness': 105.88}
5795 - {'blurriness': 96.31}
5799 - {'blurriness': 91.56}
5814 - {'zeros': 1.76}
5815 - {'zeros': 0.79}
5829 - {'blurriness': 112.0}
5838 - {'contrast': 4.95, 'zeros': 2.67}
5842 - {'contrast': 4.86, 'zeros': 4.22}
5845 - {'blurriness': 102.69}
5856 - {'blurriness': 91.38}
5871 - {'blurriness': 109.62}
5876 - {'contrast': 4.02}
5897 - {'blurriness': 98.19}
5908 - {'zeros': 1.43}
5922 - {'blurriness': 95.25}
5927 - {'contrast': 6.08, 'zeros': 1.92}
5953 - {'zeros': 1.44}
6003 - {'darkness': 0.95}
6015 - {'zeros': 0.58}
6026 - {'zeros': 3.48}
6035 - {'blurriness': 109.0}
6040 - {'zeros': 1.02}
6046 - {'blurriness': 102.81}
6056 - {'blurriness': 91.62}
6065 - {'blurriness': 103.25}
6067 - {'contrast': 4.0}
6081 - {'blurriness': 101.31}
6112 - {'contrast': 4.31, 'zeros': 11.85}
6125 - {'blurriness': 91.75}
6127 - {'blurriness': 107.5}
6133 - {'darkness': 0.73}
6138 - {'darkness': 0.73}
6145 - {'contrast': 4.82}
6165 - {'contrast': 4.82}
6170 - {'blurriness': 113.75}
6190 - {'contrast': 3.76}
6209 - {'zeros': 0.49}
6232 - {'contrast': 4.29, 'zeros': 0.78}
6234 - {'brightness': 0.04, 'contrast': 7.56, 'zeros': 1.58}
6237 - {'blurriness': 111.88}
6239 - {'contrast': 3.95}
6255 - {'contrast': 4.08}
6257 - {'darkness': 0.74}
6265 - {'blurriness': 97.12}
6281 - {'contrast': 4.14, 'zeros': 0.93}
6305 - {'blurriness': 102.56}
6315 - {'zeros': 3.25}
6361 - {'darkness': 0.84}
6372 - {'contrast': 4.35, 'zeros': 3.63}
6383 - {'contrast': 3.91}
6395 - {'darkness': 0.76}
6407 - {'blurriness': 101.62}
6413 - {'contrast': 3.89}
6437 - {'darkness': 0.84}
6450 - {'darkness': 0.83}
6455 - {'contrast': 3.83, 'zeros': 7.61}
6458 - {'blurriness': 105.5}
6475 - {'contrast': 4.43}
6494 - {'blurriness': 97.31}
6503 - {'blurriness': 114.62, 'zeros': 1.34}
6506 - {'blurriness': 90.81}
6510 - {'contrast': 4.04, 'zeros': 2.94}
6520 - {'blurriness': 119.56}
6523 - {'contrast': 4.38}
6538 - {'zeros': 0.89}
6551 - {'blurriness': 97.75}
6555 - {'contrast': 6.11, 'zeros': 8.04}
6556 - {'contrast': 4.23}
6559 - {'blurriness': 111.12}
6560 - {'blurriness': 100.12}
6564 - {'zeros': 0.7}
6567 - {'blurriness': 102.44}
6574 - {'contrast': 4.04}
6585 - {'contrast': 3.98}
6597 - {'zeros': 0.76}
6599 - {'blurriness': 102.88}
6601 - {'blurriness': 95.25}
6625 - {'contrast': 5.17}
6636 - {'blurriness': 113.88}
6656 - {'zeros': 0.96}
6664 - {'contrast': 3.8}
6668 - {'blurriness': 114.88}
6669 - {'blurriness': 112.31}
6694 - {'contrast': 4.52, 'zeros': 8.09}
6703 - {'blurriness': 95.19}
6710 - {'contrast': 4.08}
6719 - {'contrast': 4.11}
6720 - {'blurriness': 101.94}
6721 - {'zeros': 1.11}
6724 - {'zeros': 0.67}
6738 - {'blurriness': 95.75}
6740 - {'blurriness': 110.38}
6880 - {'contrast': 4.3, 'zeros': 1.39}
6881 - {'zeros': 0.6}
6885 - {'contrast': 9.15, 'zeros': 5.12}
6892 - {'zeros': 2.5}
6902 - {'blurriness': 101.12}
6904 - {'contrast': 3.82}
6909 - {'blurriness': 92.44}
6917 - {'contrast': 3.87}
6920 - {'blurriness': 110.25}
6922 - {'blurriness': 102.31}
6927 - {'zeros': 2.53}
6941 - {'contrast': 4.55}
6943 - {'blurriness': 110.88}
6970 - {'darkness': 0.79}
6990 - {'contrast': 4.02}
6997 - {'darkness': 0.75}
7010 - {'darkness': 0.77}
7015 - {'blurriness': 109.69}
7019 - {'blurriness': 109.0}
7022 - {'darkness': 0.83}
7023 - {'darkness': 0.73}
7057 - {'blurriness': 98.5}
7092 - {'blurriness': 90.69}
7105 - {'contrast': 6.29}
7107 - {'blurriness': 99.75}
7116 - {'darkness': 0.78}
7135 - {'contrast': 3.85}
7145 - {'contrast': 4.65}
7159 - {'contrast': 3.78}
7164 - {'darkness': 0.79}
7168 - {'contrast': 3.8}
7181 - {'blurriness': 93.31}
7190 - {'blurriness': 100.0}
7210 - {'zeros': 0.61}
7218 - {'blurriness': 91.94}
7230 - {'blurriness': 104.31}
7241 - {'contrast': 4.45, 'zeros': 5.21}
7242 - {'contrast': 5.15}
7245 - {'blurriness': 95.06}
7255 - {'zeros': 1.46}
7256 - {'blurriness': 94.12}
7259 - {'blurriness': 91.5}
7264 - {'blurriness': 103.06}
7276 - {'contrast': 3.93}
7282 - {'blurriness': 95.31, 'zeros': 0.55}
7289 - {'darkness': 0.87}
7301 - {'blurriness': 96.12}
7316 - {'zeros': 8.78}
7318 - {'blurriness': 98.44}
7325 - {'blurriness': 114.81}
7336 - {'blurriness': 101.88}
7338 - {'blurriness': 106.44}
7339 - {'blurriness': 112.94}
7359 - {'blurriness': 108.94}
7363 - {'zeros': 0.58}
7365 - {'blurriness': 99.19}
7383 - {'blurriness': 108.38}
7384 - {'zeros': 2.34}
7391 - {'blurriness': 115.62}
7394 - {'contrast': 3.75}
7401 - {'zeros': 1.7}
7415 - {'contrast': 4.19}
7420 - {'blurriness': 99.56}
7421 - {'zeros': 1.24}
7438 - {'zeros': 0.61}
7444 - {'blurriness': 104.75}
7449 - {'blurriness': 116.62}
7454 - {'blurriness': 105.56}
7486 - {'blurriness': 107.94, 'zeros': 2.1}
7504 - {'zeros': 0.56}
7518 - {'contrast': 3.74}
7523 - {'darkness': 0.85}
7529 - {'blurriness': 113.25}
7537 - {'blurriness': 92.44}
7550 - {'zeros': 0.93}
7565 - {'contrast': 3.75}
7589 - {'blurriness': 104.31}
7591 - {'blurriness': 96.12}
7606 - {'blurriness': 102.25}
7634 - {'zeros': 0.45}
7651 - {'blurriness': 99.38}
7691 - {'zeros': 0.46}
7708 - {'blurriness': 120.19}
7735 - {'darkness': 0.78}
7736 - {'contrast': 4.4}
7757 - {'contrast': 3.95}
7763 - {'contrast': 4.25}
7764 - {'contrast': 3.84}
7779 - {'blurriness': 95.5}
7789 - {'contrast': 3.84, 'zeros': 1.67}
7794 - {'contrast': 6.62, 'zeros': 13.48}
7803 - {'darkness': 0.98}
7810 - {'contrast': 3.87}
7811 - {'blurriness': 96.88}
7813 - {'darkness': 0.83}
7821 - {'blurriness': 102.19}
7831 - {'blurriness': 101.56}
7835 - {'darkness': 0.94, 'zeros': 0.84}
7840 - {'zeros': 0.78}
7845 - {'zeros': 0.85}
7853 - {'contrast': 5.01}
7864 - {'zeros': 0.99}
7870 - {'contrast': 5.28}
7881 - {'blurriness': 105.19}
7900 - {'zeros': 1.31}
7907 - {'blurriness': 96.44}
7916 - {'blurriness': 96.56}
7940 - {'contrast': 3.75}
8002 - {'zeros': 1.77}
8014 - {'blurriness': 94.38}
8017 - {'blurriness': 99.38}
8020 - {'blurriness': 92.5}
8059 - {'zeros': 0.53}
8061 - {'darkness': 0.86}
8070 - {'contrast': 4.76}
8074 - {'zeros': 0.61}
8087 - {'blurriness': 96.06}
8094 - {'zeros': 1.53}
8100 - {'blurriness': 102.62}
8109 - {'blurriness': 118.62}
8166 - {'contrast': 3.81}
8180 - {'blurriness': 108.81}
8227 - {'contrast': 4.13}
8230 - {'darkness': 0.84}
8241 - {'darkness': 0.77}
8244 - {'contrast': 8.46, 'zeros': 5.01}
8272 - {'contrast': 3.74}
8273 - {'blurriness': 91.31}
8309 - {'blurriness': 118.88}
8313 - {'blurriness': 93.81}
8318 - {'contrast': 5.02}
8338 - {'blurriness': 99.0}
8344 - {'zeros': 0.43}
8348 - {'contrast': 5.72}
8359 - {'blurriness': 114.56}
8366 - {'zeros': 1.08}
8370 - {'blurriness': 90.56}
8371 - {'zeros': 0.51}
8381 - {'contrast': 6.58, 'zeros': 7.43}
8425 - {'blurriness': 110.44}
8435 - {'zeros': 2.38}
8448 - {'contrast': 8.55, 'zeros': 3.87}
8449 - {'contrast': 5.88}
8469 - {'blurriness': 117.69}
8476 - {'contrast': 4.02}
8484 - {'zeros': 1.21}
8490 - {'contrast': 4.08}
8492 - {'zeros': 0.46}
8497 - {'blurriness': 97.75}
8500 - {'blurriness': 114.75}
8504 - {'zeros': 0.48}
8529 - {'zeros': 0.75}
8542 - {'contrast': 4.3}
8562 - {'blurriness': 106.44}
8580 - {'zeros': 0.47}
8595 - {'contrast': 5.85, 'zeros': 5.96}
8598 - {'zeros': 1.59}
8618 - {'contrast': 4.18}
8638 - {'darkness': 0.75}
8647 - {'blurriness': 118.44}
8654 - {'zeros': 0.48}
8684 - {'zeros': 9.45}
8722 - {'contrast': 5.28, 'zeros': 9.85}
8726 - {'zeros': 0.73}
8728 - {'contrast': 3.86}
8741 - {'blurriness': 96.69}
8742 - {'zeros': 1.38}
8743 - {'zeros': 2.99}
8753 - {'blurriness': 95.94}
8756 - {'blurriness': 105.0}
8768 - {'contrast': 6.81}
8771 - {'blurriness': 90.94}
8775 - {'contrast': 4.27, 'zeros': 0.7}
8784 - {'blurriness': 104.19}
8798 - {'contrast': 3.82}
8800 - {'darkness': 0.76}
8810 - {'zeros': 4.06}
8812 - {'darkness': 0.76}
8813 - {'zeros': 0.46}
8815 - {'zeros': 0.69}
8816 - {'blurriness': 103.38}
8831 - {'zeros': 0.45}
8835 - {'contrast': 6.07, 'zeros': 4.54}
8837 - {'zeros': 0.43}
8845 - {'blurriness': 111.0}
8850 - {'contrast': 5.14}
8903 - {'darkness': 0.99}
8924 - {'blurriness': 111.56}
8954 - {'blurriness': 111.69}
8959 - {'zeros': 0.71}
8960 - {'darkness': 0.85}
8963 - {'blurriness': 91.19}
8974 - {'blurriness': 112.94}
8982 - {'contrast': 5.01}
8988 - {'darkness': 0.75}
9034 - {'blurriness': 114.75}
9052 - {'darkness': 0.76}
9059 - {'contrast': 4.16}
9074 - {'blurriness': 99.31}
9080 - {'darkness': 0.74}
9090 - {'blurriness': 98.44}
9108 - {'blurriness': 118.81}
9116 - {'blurriness': 99.38}
9119 - {'blurriness': 120.19}
9163 - {'blurriness': 99.19}
9170 - {'zeros': 0.47}
9172 - {'zeros': 1.21}
9181 - {'blurriness': 94.94}
9187 - {'contrast': 3.88}
9191 - {'contrast': 3.92}
9205 - {'blurriness': 98.69}
9212 - {'zeros': 0.69}
9215 - {'contrast': 3.86}
9232 - {'blurriness': 103.31}
9241 - {'blurriness': 107.0}
9246 - {'brightness': 0.04, 'contrast': 13.84, 'zeros': 16.05}
9250 - {'contrast': 4.18, 'zeros': 1.12}
9255 - {'zeros': 1.46}
9269 - {'contrast': 3.81}
9290 - {'blurriness': 115.44}
9292 - {'contrast': 3.88}
9301 - {'contrast': 3.91}
9323 - {'zeros': 2.57}
9328 - {'contrast': 4.62, 'zeros': 6.41}
9337 - {'contrast': 3.86}
9344 - {'contrast': 5.86, 'zeros': 0.61}
9354 - {'darkness': 0.76}
9358 - {'zeros': 0.53}
9365 - {'contrast': 3.87}
9385 - {'zeros': 5.73}
9393 - {'contrast': 4.51}
9403 - {'contrast': 4.8, 'zeros': 7.57}
9426 - {'blurriness': 108.38}
9473 - {'blurriness': 98.5}
9482 - {'zeros': 0.55}
9495 - {'blurriness': 116.44}
9511 - {'contrast': 3.81}
9569 - {'contrast': 3.81}
9573 - {'blurriness': 92.38}
9590 - {'blurriness': 107.62, 'zeros': 4.2}
9592 - {'zeros': 0.5}
9597 - {'zeros': 0.54}
9601 - {'zeros': 7.39}
9608 - {'blurriness': 92.19}
9609 - {'contrast': 5.28}
9613 - {'blurriness': 108.81}
9616 - {'zeros': 0.62}
9630 - {'blurriness': 108.81}
9640 - {'blurriness': 114.25}
9665 - {'blurriness': 96.94}
9679 - {'contrast': 3.88}
9686 - {'zeros': 0.82}
9689 - {'blurriness': 92.81}
9693 - {'contrast': 4.39}
9694 - {'contrast': 4.31}
9699 - {'zeros': 0.56}
9705 - {'contrast': 4.76, 'zeros': 2.79}
9713 - {'zeros': 0.81}
9728 - {'contrast': 4.12}
9744 - {'zeros': 0.91}
9747 - {'darkness': 0.76}
9750 - {'blurriness': 101.12}
9763 - {'contrast': 4.24, 'zeros': 8.78}
9765 - {'contrast': 7.12, 'zeros': 5.76}
9766 - {'blurriness': 111.81}
9767 - {'blurriness': 96.88}
9768 - {'blurriness': 102.25}
9776 - {'contrast': 3.89}
9782 - {'contrast': 4.18}
9783 - {'blurriness': 101.38, 'zeros': 0.57}
9787 - {'blurriness': 91.0}
9801 - {'zeros': 3.49}
9802 - {'darkness': 0.87}
9822 - {'blurriness': 107.94}
9842 - {'contrast': 4.39}
9848 - {'darkness': 0.99}
9849 - {'blurriness': 109.81}
9853 - {'blurriness': 94.69}
9857 - {'contrast': 3.75, 'zeros': 4.62}
9902 - {'zeros': 0.94}
9907 - {'contrast': 4.21}
9921 - {'darkness': 0.97}
9935 - {'zeros': 0.67}
9951 - {'darkness': 0.75}
9962 - {'blurriness': 100.44}
9964 - {'blurriness': 97.38}
9966 - {'zeros': 0.86}
9980 - {'zeros': 0.89}
9989 - {'blurriness': 106.25}
9997 - {'contrast': 3.98}