diff options
| author | CaptainJack2491 <jayrupnakawala@gmail.com> | 2026-03-06 17:17:05 +0000 |
|---|---|---|
| committer | CaptainJack2491 <jayrupnakawala@gmail.com> | 2026-03-06 17:17:05 +0000 |
| commit | b2c7114d2042bc88c5ee33e8597704c32efd1026 (patch) | |
| tree | 68b0923ffbd3c4cb5cc22b85b124289904c9f3cd /papers/confessions_paper.pdf | |
| parent | 08fe9e0943aac5806beecb4ad38e25378e866e05 (diff) | |
feat(judge): add selective judging and log filtering
- Implement enabled_judges parameter in Judge class to selectively run regex, blackbox, or glassbox checks.
- Add --judges CLI argument to judge_runner.py for granular control over judging pipeline.
- Add --model and --scenario filters to judge_runner.py for targeted evaluation of experiment logs.
- Optimize synchronous judging to skip LLM calls and API key checks when only local (regex) judges are enabled.
- Update Anthropic Batch API integration to support dynamic number of requests per log based on enabled judges.
- Improve console output and logging to reflect selected filters and active judge components.
Diffstat (limited to 'papers/confessions_paper.pdf')
0 files changed, 0 insertions, 0 deletions