fair_forge.eval

Classes

Split(…)

Enum for different split methods used in evaluation.

Functions

evaluate(dataset, methods, metrics, ...[, ...])

Evaluate methods on a dataset using specified metrics and group metrics.

class fair_forge.eval.Split(*values)

Bases: Enum

Enum for different split methods used in evaluation.

BASIC = 'basic'

PROPORTIONAL = 'proportional'

fair_forge.eval.evaluate(dataset: GroupDataset, methods: Mapping[str, Method | GroupMethod], metrics: Sequence[Metric], group_metrics: Sequence[GroupMetric], *, preprocessor: Preprocessor | None = None, repeat: int = 1, split: Split | SplitMethod = Split.PROPORTIONAL, seed: int = 42, train_percentage: float = 0.8, remove_score_suffix: bool = True, seed_methods: bool = True) → DataFrame

Evaluate methods on a dataset using specified metrics and group metrics.