diff options
| author | CaptainJack2491 <jayrupnakawala@gmail.com> | 2026-02-25 16:00:55 +0000 |
|---|---|---|
| committer | CaptainJack2491 <jayrupnakawala@gmail.com> | 2026-02-25 16:10:37 +0000 |
| commit | 375eddf1bd4e23db80feb74c6272dad610345795 (patch) | |
| tree | a35dea3c2e3f137b759ffa06a336dd774f7ce2fd /scenarios/child_protection/oversight | |
| parent | a144c05e090fa54ccb12b448b15238f579dda414 (diff) | |
feat: implement judging system with regex, blackbox, and glassbox checks
- Add src/judge.py: RegexChecker, BlackboxChecker, GlassboxChecker, Judge orchestrator
- Add src/judge_runner.py: CLI for batch/single judging with CSV output
- Add regex_rules.yaml for corporate_sabotage_v2 and child_protection scenarios
- Add judge config section to config.yaml (model, temperature, log_dir)
- Add tests/test_judge.py: 34 unit tests covering all components
- Uses Anthropic Batch API for half-cost LLM judge calls
- Judge logs include full CoT reasoning and judge model for auditability
Diffstat (limited to 'scenarios/child_protection/oversight')
0 files changed, 0 insertions, 0 deletions
