fair_forge.eval

Functions

evaluate(dataset, methods, metrics, ...[, ...])

Evaluate methods on a dataset using specified metrics and group metrics.

fair_forge.eval.evaluate(dataset: GroupDataset, methods: Mapping[str, Method | GroupMethod], metrics: Sequence[Metric], group_metrics: Sequence[GroupMetric], *, preprocessor: Preprocessor | None = None, repeat: int = 1, split: Split = 'proportional', seed: int = 42, train_percentage: float = 0.8, remove_score_suffix: bool = True, seed_methods: bool = True) → DataFrame

Evaluate methods on a dataset using specified metrics and group metrics.