summaryrefslogtreecommitdiff
path: root/scripts/judge_comparison.py
AgeCommit message (Collapse)Author
2026-04-10refactor(judge): simplify to single judge per prong, auto-create sync clientsCaptainJack2491
BREAKING CHANGE: Judge API now uses single blackbox_model/glassbox_model instead of lists with aggregation. Changes: - Judge auto-creates sync clients from model configs (supports anthropic, openai, xai) - Removed multi-model aggregation support (aggregate_results method removed) - New: create_sync_clients_for_models() and get_supported_providers() - Updated judge_runner.py to use new single-judge API - Added scripts/judge_comparison.py for testing judge model pairs - Updated v2_redesign notes to reflect implementation status