Package org.egothor.methodatlas.eval
package org.egothor.methodatlas.eval
AI-classification accuracy evaluation: scores AI predictions against a
human-reviewed labelled set (the
ClassificationOverride YAML format)
and reports precision, recall, F1 and support per taxonomy tag and for the
securityRelevant decision.
AccuracyMetrics is the pure metric math,
AccuracyEvaluator joins labels with
predictions, and AccuracyReportRenderer
renders Markdown or JSON. Nothing in this package calls an AI provider.
-
ClassDescriptionJoins AI predictions with human-reviewed labels and scores them with
AccuracyMetrics.Metrics together with the coverage bookkeeping of the join.Pure, deterministic computation of AI-classification quality metrics from (prediction, truth) pairs.Confusion counts for one binary decision.The complete metric set.One method for which a prediction is compared with a human label.Metrics of a single taxonomy tag.Renders anAccuracyEvaluator.Evaluationas Markdown or JSON.