summaryrefslogtreecommitdiff
path: root/config.yaml
AgeCommit message (Collapse)Author
2026-02-26chore: add .env.example + config.yaml.example, gitignore config.yamlCaptainJack2491
- Create .env.example with placeholder keys for all providers - Create config.yaml.example with clean reference config - Add config.yaml and judge_logs/ to .gitignore - Load .env in judge.py for standalone usage
2026-02-25feat: implement judging system with regex, blackbox, and glassbox checksCaptainJack2491
- Add src/judge.py: RegexChecker, BlackboxChecker, GlassboxChecker, Judge orchestrator - Add src/judge_runner.py: CLI for batch/single judging with CSV output - Add regex_rules.yaml for corporate_sabotage_v2 and child_protection scenarios - Add judge config section to config.yaml (model, temperature, log_dir) - Add tests/test_judge.py: 34 unit tests covering all components - Uses Anthropic Batch API for half-cost LLM judge calls - Judge logs include full CoT reasoning and judge model for auditability
2026-01-11[fix] simplified everythingCaptainJack2491
made eveyrthing much cleaner and it works very well. got rid of providers setup, only use openai sdk now.
2026-01-11[fix] big moving around, probably made lot more bugs.CaptainJack2491