The main interface

Consistency testing (`check`)

The test functions implemented in the mlscorecheck.check module.

Binary classification

Multiclass classification

Regression

Test bundles (`bundles`)

The test bundles dedicated to specific problems in the mlscorecheck.bundles module.

Retina Image Processing

The test functions dedicated to retina image processing problems.

DRIVE

STARE

HRF

CHASE_DB1

DIARETDB0

DIARETDB1

DRISHTI_GS

Preterm delivery prediction by EHG signals

The test bundle dedicated to the testing of electrohsyterogram data.

Skin lesion classification

The test bundle dedicated to the testing of skin lesion classification.

ISIC2016

ISIC2017

Experiments (`experiments`)

The predefined dataset and experiment statistics to look up are stored in the mlscorecheck.experiments module.

The core modules

Score functions (`scores`)

Testing logic for individual scores (`individual`)

The main, low level interface function of the module is check_scores_tptn_pairs.

Testing logic for aggregated scores (`aggregated`)

The main, low level interface function of the module is check_aggregated_scores.